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•'/  Objectives 

“  r 

This  project  proposes  to  Investigate  the  effectiveness  of  prototype  and 
generalized  geometric  programming  (GP)  developments  In  the  routine  solution  of 
Inequality  constrained  algebraic  programs.  The  research  seeks  to  elucidate 
under  what  conditions  which  of  the  equivalent  prototype  GP  problem  forms:  primal, 
convexified  primal,  transformed  primal,  and,  or  transformed  dual,  as  well  as 
their  generalized  GP  analogous  are  best  solved  and  under  what  conditions.  More¬ 
over,  direct  and  sequential  strategies  will  be  examined  to  identify  the  most 
efficient  strategies  for  the  solution  of  GGP's.  The  computational  tests  in  the 
study  will  be  performed  using  the  leading  specialized  GP  and  GGP  codes  as  well 
as  a  selection  of  general  nonlinear  programming  codes.  Statistical  tests  will 
be  employed  to  deduce  suitable  measures  of  prototype  and  generalized  GP  problem 
difficulty.  - 

i 

Executive  Summary 

The  research  performed  under  this  project  is  divided  into  two  parts.  Part  I 
Involved  the  study  of  prototype  GP  problems.  Part  II  concerned  the  study  of 
generalized  GP  problems. 

In  Part  I  fourteen  test  series  involving  ten  codes  or  code  variants  were 
carried  out  to  solve  the  five  equivalent  posynomlal  GP  problem  formulations. 

Four  of  the  codes  used  were  general  NLP  codes;  six  were  specialized  GP  codes. 

Codes  were  selected  on  the  basis  of  previous  comparative  studies  as  well  as 
preliminary  studies  carried  out  as  part  of  this  project.  A  total  of  fourty- 
two  test  problems  representing  both  engineering  applications  and  artificially 
constructed  problems  were  assembled.  Each  test  series  Involved  solution  of  each 
test  problem  from  up  to  twenty  randomly  generated  starting  points.  Starting 
point  replication  was  shown  to  be  essential  to  producing  statistically 


justifiable  rankings.  On  the  basis  of  statistical  tests,  the  convex  primal 
formulation  was  shown  to  be  Intrinsically  easiest  to  solve  for  general  problems. 
The  difference  between  the  primal  and  convex  primal  formulations  were  found  to 
lie  mainly  In  scaling  and  function  evaluation  time.  Yet  these  differences 
typically  led  to  differences  in  solution  times  by  factors  of  two  to  ten  or  more. 
In  problems  with  special  combinations  of  characteristics  (low  degree  of  diffi¬ 
culty)  and  mostly  tight  constraints;  dual  approaches  can  be  competitive.  A 
general  purpose  GRG  code  applied  to  the  convex  primal  was  shown  to  be  highly 
competitive  with  the  reputedly  best  specialized  GP  codes  currently  available. 

The  effectiveness  of  the  highly  regarded  specialized  codes  GGP  and  GPKTC  appear 
largely  to  be  due  to  the  fact  that  these  codes  solve  the  convex  primal  formula¬ 
tion.  These  results  therefore  do  cast  considerable  doubts  on  the  computational 
significance  of  many  years  of  research  into  prototype  GP  solution  algorithms. 
Finally,  a  correlation  analysis  was  carried  out  to  show  that  posynomlal  GP 
problem  difficulty  as  measured  in  solution  time  is  best  correlated  to  an  expo¬ 
nential  of  the  number  of  variables  in  the  formulation  being  solved  and  is  pro¬ 
portional  to  the  total  number  of  multi-term  primal  constraints. 

In  Part  II  of  this  study,  ten  test  series  involving  five  codes  were  carried 
out  to  solve  four  generalized  GP  problem  formulations.  Four  of  the  codes  used 
were  specialized  GP  codes,  one  code  was  a  general  NLP  program.  The  latter  was 
the  code  proven  most  effective  in  Part  I  of  this  project.  A  total  of  twenty- 
five  test  problems,  again  representing  both  engineering  applications  and  artifi¬ 
cially  constructed  problems,  was  selected  and  both  signomlal  and  reversed 
posynomlal .formulations  developed.  Each  test  series  involved  solution  of  each 
test  problem  from  up  to  twenty  randomly  generated  starting  points  as  in  Part  I. 
On  the  basis  of  statistical  tests  the  preferred  solution  approach  was  shown  to 
involve:  use  of  the  quotient  form  of  the  signomlal  functions;  condensation 
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of  the  denominators  of  the  quotients  using  Duffin's  geometric  mean  construction; 
and  solution  of  the  condensed  subproblems  In  their  convexlfled  subproblem  form. 

The  code  GGP  which  employed  this  strategy  was  shown  to  be  most  effective. 

Direct  GRG  solution  of  the  exponential  form  of  the  primal  was  shown  to  be  next 
best.  On  the  basis  of  the  Part  I  results,  it  Is  certain  that  use  of  the  GRG 
code  with  the  above  three  part  strategy  will  be  competitive  with  GGP.  A  var¬ 
iation  of  this  strategy  In  which  the  condensed  subproblems  are  solved  In  their 
transformed  dual  form  was  shown  to  be  effective  for  problems  in  which  the  degree 
of  freedom  Is  much  smaller  than  the  number  of  primal  variables.  The  use  of 
condensation  and  the  quotient  representation  of  slgnomial  functions  thus  appears 
to  be  the  most  computationally  significant  development  arising  from  generalized 
GP  research.  As  In  Part  I  a  correlation  analysis  was  performed  to  deduce  a 
measure  of  generalized  GP  problem  difficulty.  The  number  primal  variables  and 
multi-term  constraints  were  shown  to  be  strongly  exponentially  correlated. 

Depending  upon  the  prlmaT  form  used,  the  solution  time  Is  strongly  correlated 
to  the  number  of  negative  terms  or  the  number  of  reversed  constraints.  It  appears 
that  the  number  of  multi-term  constraints  Is  more  significant  than  the  division 
between  posynomlal  and  slgnomial  constraints. 

In  addition  to  these  GP  oriented  results,  this  project  has  developed  sig¬ 
nificant  methodological  advances  In  the  field  of  numerical  evaluation  of  NLP 
software.  Progress  In  the  work  of  this  project  was  reported  at  several  symposia 
Including  the  COAL  Sessions  held  at  the  Montreal  Mathematical  Programming  Sym¬ 
posium.  One  paper  has  been  published,  one  will  appear  in  a  special  Mathematical 
Programing  Study,  and  a,  third,  Is  under  review. 
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Part  I.  Posynomlal  Study 
1.  Introduction 

Geometric  Programming  (GP)  Is  a  body  of  theoretical  and  algorithmic 
results  concerned  with  constrained  optimization  problems  Involving  a  class 
of  nonlinear  algebraic  functions  [1].  Since  the  Initial  work  of  Zener  some 
16  years  ago,  GP  has  undergone  considerable  theoretical  development,  has 
experienced  a  proliferation  of  proposals  for  numerical  solution  algorithms, 
and  has  enjoyed  considerable  practical  application.  At  the  present  time 
the  field  Is  undergoing  a  period  of  consolidation  and  thus  a  reappraisal 
of  the  practical  and  computational  significance  of  the  developed  theory 
appears  to  be  appropriate. 

This  paper  Is  the  second  of  a  series  of  studies  on  the  computation-  \ 

> 

al  utility  of  GP  formulations  and  developments.  The  overall  goals  of  this 
research  are  to  determine: 

1)  whether  the  constructions  resulting  from  GP  theory  offers  any 
*  computational  advantages  over  conventional  NLP  methodology 

11)  which  of  the  various  equivalent  GP  problem  formulations 
are  preferable  and  under  what  conditions 

111)  which  GP  algorithm/formulation  combination  is  most  likely 
to  be  successful  for  a  given  problem 
1v)  whether  a  criteria  can  be  defined  by  means  of  which  GP 
problem  difficulty  can  be  gauged. 

While  the  overall  scope  of  our  research  encompasses  both  prototype 
and  generalized  GP,  the  present  paper  is  confined  to  the  prototype  problem. 

By  way  of  review  for  the  novice  In  GP,  In  the  next  section  we  summarize 
the  five  equivalent  prototype  GP  problems  formulations. 
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2.  Equivalent  GP  problem  structures 
2.1  The  Primal  Problem 


The  prototype  geometric  programming  problem  (P)  Is 


Hlnlmlze:  gQ(x) 

Subject  to:  gk(x)  <  1 


k  *1 . K 


x  >  0 


where  the  posynomlal  functions  9k(x)  are  defined  as 

Tl.  It 


£  c,  n 
*  sk  1  n-1  " 


with  specified  positive  coefficients  ct  and  specified  real  exponents 
ant*  The  term  ^nd^ces  *  are  consecutively  as 


V1 


Sk+1  "  Tk+1 


tk,t 

The  above  problem  Is  In  general  a  non-convex  programming  problem  which 

#, 

because  of  the  nonl Inearl  ties  of  the  constraints  can  be  expected  to  sev¬ 
erely  tax  conventional  nonlinear  programming  codes.  However,  despite  the 
apparent  difficulty  of  the  primal  problem,  there  are  structural  features 
of  the  generalized  posynomlal  functions  which  can  be  exploited  to  facilitate 
direct  primal  solutions. 

2.2  The  Convexlfled  Primal  Problem 

An  Interesting  property  of  the  primal  functions  Is  that  with  the 
change  of  variable, 

xn  ■  exp  (t),  n  ■  1,.,  N 

they  are  transformed  to  convex  functions.  This  underlying  convexity  of 


the  posynomlal  functions  imp- ies  that  the  primal  problem  is  basically  a 
convex  programming  problem  in  the  convex  functions, 

9kU)  *  t  ct  exp  (I  ant>n) 

This  feature  can  be  used  to  great  advantage  in  computation  since 
It  permits  application  of  any  of  a  number  of  convex  programming  algorithms. 
Note  that  the  variables  In  the  convex  form  of  the  primal  are  unrestricted 
In  sign  whereas  the  original  primal  variables  must  be  positive. 

2.3  The  Transformed  Primal  Problem 

The  convexified  primal  can  with  a  further  change  of  variable, 
w  =  AT  4  +  In  $ 

be  converted  to  a  transformed  primal  auxiliary  problem  which  has  the 
following  revealing  structure: 

T  w 

Minimize:  g  (w)  =  Z°  e  t 

0  t=l 

-  Subject  to:  g.  ( w)  .  e*  e  Wt  -  1  k’1 . K 

“  “Sk 

L(w  -  lnjj)  -  0 

where  the  rows  of  the  matrix  L  are  any  set  of  linearly  Independent  vectors 
spanning  the  null  space  of  the  exponent  matrix  A  and  where  ln£  *  (lnc-j, 

lnc2 . ,lnct).  It  Is  readily  shown  that  this  transformed  primal  is  in 

general  a  reduced  equivalent  and,  If  A  has  full  rank,  is  exactly  equivalent 
to  the  primal  problem  [2,3].  Given  a  solution,  w*»  of  TP  a  primal  solution 
be  recovered  by  solving  the  linear  system, 

K  *  *  AT*  +  In* 

for  the  transformed  primal  variables  and  simply  exponentiating  the  result 
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2.4  The  Dual  Problem 

As  shown  by  Ouffin,  et.  al.,  [1],  the  primal  GP  problem  has  associated 
with  It  a  dual  problem  (0), 


Maximize: 

Subject  to: 


where 


and  where  by 


T 

v($)  -  n  (ct/6  ) 
t=l 

To 

Z  6.-1 

t=1  1 

A6  =  0 
6>  0 


definition 


n 

k=l 


»••••» 


K 


Uni  (c^A. /«. )6t  =  0 
5t+0  z  K  z 

It  Is  well  known  that  at  their  respective  optima,  and  £*, 
»($*)  =  90(**) 


and  that  the  primal  and  dual  solutions  are  related  by  the  following  log 
linear  equations  which  are  defined  for  those  t  with  >  0, 


N 

I  ant  lnx*  =  f  in  (6£v(fi*)/ct)  l<t<J0 
1  ,6*  *.  S  <  t  < 

L,n(  t/ctV  m-l . 


-  '  -  Tm 
M 


It  Is  further  known  that  the  logarithm  of  v(S)  Is  a  concave  function 
which  Is  continuously  differentiable  over  the  positive  orthant.  Hence,  the 
dual  problem  with  logarithmic  objective  function  Is  a  linearly  constrained 


concave  program. 

There  are,  however,  three  major  complications  associated  with  the 
direct  maximization  of  the  dual: 

1)  The  gradient  of  ln(v($))  is  not  defined  when  any  dual  variable 

«r°- 

2)  If  *  0  for  some  t,  Sk  £  t  £  Tk,  and  k,  1  <  k  K,  then  all 

dual  variables  6|,  associated  with  constraint  k  must  equal  zero. 

3)  It  is  possible  that  the  system  of  log  linear  equations  which 

must  be  solved  to  determine  the  optimal  primal  variables  may 
lead  to  inaccurate  solutions  or  that  its  rank  may  be  less  than  N. 

The  second  of  these  difficulties  can  be  mitigated  if  the  definitions 

of  the  variables  are  explicitly  incorporated  as  constraints  into  the 
problem  formulation  and  the  Xk  are  explicitly  treated  as  independent 
variables.  The  first  part  of  the  third  complication  can  be  avoided,  as 
pointed  out  by  Dembo  [5]  ,  if  the  primal  variables  are  recovered  as  Kuhn- 
Tucker  multipliers  of  the  dual  constraints.  If  the  rank  Is  less  than  N, 
a  subsidiary  maximation  of  the  dual  problem  must  be  undertaken  prior  to  the 
recovery  of  the  primal  solutions  [4]  .  The  problem  of  non-differentiability 
when  6^  *  0  has  to  date  been  treated  by  either  setting  arbitrarily  small 
lower  bounds  6^  e  or  by  introducing  penalized  slack  variables  [6]  . 

2.5  The  Transformed  Dual  Problem 

An  alternate  way  of  formulating  the  dual  program  is  to  eliminate 
the  linear  equality  constraints  by  solving  them  for  the  dual  variables 
In  parametric  form.  Using  this  device  the  dual  variable  can  be 
expressed  as  the  sum  of  a  particular  solution  and  a  linear  combination 
of  T-N-l  homogeneous  solutions  of  the  N+l  dual  constraints.  Thus,  all 
feasible  values  of  the  dual  variables  will  be  given  by  the  parametric 


6 
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equations.  T-N-l 

st  ■  b°t  * E  bt 

j=l 

where  Jj°  Is  any  particular  dual  feasible  solution  and  the  are  any 
basis  of  the  solution  space  of  the  homogeneous  form  of  the  dual  constraints. 
In  this  manner,  the  following  Transformed  Dual  Program  can  be  constructed. 


T  (  ct  )  6t^  K 

Maximize: 

v{y)  =  n  (.  /  x)  n  xk 

t=l  Vy'  k=i  K 

Subject  to: 

D  . 

6(y)  =  b°  +  E  bJ  yi  >  0 

j-r  J 

where 

Th 

\ (y) 


and  where  the  yj,  j=l,..,  D  (=T-N-1)  are  unrestricted  in  sign. 

The  above  is  a  maximization  problem  in  D  unrestricted  variables 
subject  to  T  linear  inequality  constraints.  The  following  properties  of 
this  problem  are  well  known: 

i)  The  logarithm  of  v(y)  is  a  continuously  differentiable  concaye 
function  within  the  positive  orthant. 

11)  if  all  primal  constraints  are  active  at  the  optimum,  then  at 

the  corresponding  dual  optimum  all  T  transformed  dual  inequality 
constraints  will  be  inactive.  Hence,  the  transformed  dual  will 


take  on  an  unconstrained  maximum. 

Ill)  If  primal  constraint  k  is  inactive  at  the  optimum,  then  6t(y)=0, 
t=Sk,..,Tk,  and  the  corresponding  transformed  dual  constraints 
must  be  satisfied  simultaneously  as  equalities. 

While,  from  a  computational  point  of  view,  the  second  is  a  very 


desirable  property,  the  third  ver>  definitely  Is  not  since  It  requires 
Implementation  of  forcing  strategies  to  ensure  that  blocks  of  TO  constraints 
become  tight  simultaneously. 

3.  Scope  of  the  Present  Study 

From  the  preceding  review  and  from  the  summary  given  in  Table  1, 

It  Is  evident  that  the  various  GP  problem  formulations  differ  in  variable 
dimensionality;  in  number,  type,  and  functional  form  of  their  constraints,  as 
well  as  In  the  particular  regularity  conditions  which  must  be  satisfied. 
Numerous  algorithms  have  been  reported  in  the  GP  literature  for  these 
various  f''  mulations  exploiting  their  peculiarities.  In  the  present  work 
we  gathered  experimental  data  on  the  performance  of  ten  codes  or  code 
variants  in  solving  a  battery  of  42  test  problems  each  solved  from  up 
to  20  different  starting  points.  Four  previous  comparative  studies  of 
prototype  GP  solution  approaches  have  been  reported  in  the  literature.  Two 
of  these,  Rijckaert  and  Martens  [7]  and  Dembo  [5]  primarily  focused  on 
generalized  GP's  but  did  include  prototype  problems  in  their  test  slate. 

The  study  by  Dinkel,  et.  al.  [8]  was  restricted  to  the  examination  of 
alternative  cutting  plane  methods  used  for  the  solution  of  the  convex  primal. 
Sarma,  et.  al.  [9],  in  what  may  be  viewed  as  a  pilot  to  the  present  work, 
considered  primal,  dual,  and  transformed  primal  solution  approaches  and 
attempted  to  draw  conclusions  about  the  preferred  approach. 

Rijckaert  and  Marten's  tests  were  restricted  to  eight  prototype 
problems,  used  single  starting  points,  and  generally  employed  penalized 
slack  variables  to  avoid  difficulties  with  loose  constraints.  The  algorithms 
tested  Included 

1)  dual  and  transformed  dual  maximization  approaches:  convex  simplex 
method,  successive  IP  solution,  separable  programming,  gradient 
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projection,  modified  Newton  solution  of  the  transformed  dual, 
il)  various  strategies  for  solving  the  Kuhn-Tucker  optimality  conditions 
(in  either  primal  or  dual  form)  using  Newton-Raphson  methods 
111)  two  convex  primal  solution  algorithms,  GPKTC  and  GGP 
Although  the  test  results  were  quite  limited,  the  convex  simplex 
method  adaptation  due  to  Beck  and  Ecker  [10]  appeared  to  be  the  most 
reliable,  if  not  always  the  fastest,  dual  maximization  approach;  the  convex 
primal  approach  GPKTC  appeared  to  be  the  best  overall  with  GGP  second. 

Dembo  [5]  Included  six  prototype  problems  In  his  testing  but  these  six 
were  parameter  variants  of  only  three  original  problems.  The  codes  tested 
consisted  of  several  good  general  NLP  codes  applied  directly  to  the  primal 
as  well  as  several  specialized  GP  codes,  including  GGP  and  GPKTC  but  not 
the  Beck  and  Ecker  program.  The  test  problems  were  run  by  the  code  authors 
on  their  own  machines;  using  a  single  set  of  starting  points;  allowing 
tuning  of  programs  by  the  authors;  but  requiring  the  solutions  to  meet  fixed 
tolerances.  Solution  times  were  compared  using  Colville  standard  times.  For 
the  prototype  problems,  GGP  and  GPKTC  gave  the  fastest  times,  often  by 
nearly  a  factor  of  two  better  than  the  best  of  the  NLP  times.  However,  the 
validity  of  using  Colville  standardized  times  has  since  been  seriously 
questioned  by  Eason  [11]  who  showed  that  standardized  times  for  a  given 
program  on  different  machines  can  differ  by  an  order  of  magnitude. 

Sarma,  et.  al .  [9],  solved  21  prototype  problems  using  two  variants  of 
the  Beck  and  Ecker  code,  a  penalty  method  specialized  to  the  GP  primal,  a 
code  which  solves  the  GP  transformed  primal  (DAP),  and  GGP.  One  to  three 
starting  points  were  used  and  solutions  were  timed  to  achieve  a  specified 
constraint  tolerance  (.001)  as  well  as  a  specified  objective  function 
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tolerance  (within  1/4%  of  optimum  value).  The  last  three  codes  used 
starting  points  generated  by  DAP  but  suitably  transformed;  while  the 
Beck  and  Ecker  code  was  allowed  to  generate  its  own  starting  points. 

The  study  Indicated  that  the  penalized  slack  variable  device  was  generally 
less  effective  than  the  block  strategy  used  in  the  unmodified  Beck  and 
Ecker  code  (MCS).  The  GGP  code  was  often  faster  than  DAP  and  significantly 
faster  than  the  direct  primal  approach.  In  retrospect 

the  experimental  procedure  in  this  study  was  lacking  in  three  respects. 

Code  timing  Included  starting  point  generation  in  the  case  of  MCS  and  DAP 
but  not  with  the  others;  the  constraint  tolerance  was  the  primary  tolernace 
parameter  in  two  of  the  codes,  hence,  the  objective  function  tolerance 
*  could  not  be  precisely  controlled;  and,  run  replication  was  too  small. 

In  the  present  work  we  will  attempt  to  rectify  some  of  the  experimental 
inadequacies  of  the  previous  studies:  a  large  number  of  problems  will  be 
used;  up  to  20  replications  using  different  starting  points  will  be  run; 
appropriate  statistical  tests  will  be  used  for  comparisons;  results  will 
be  obtained  at  several  precise  error  levels;  and  code  timing  will  be 
controlled  to  exclude  starting  point  generation  and  extraneous  I/O.  In 
addition,  the  experiments  will  be  designed  such  that,  at  least  for  the  various 
primal  formulations,  formulation  effects  can  be  separated  from  algorithm 
effects. 

4,  Experimental  Procedure 
4.1  Test  Codes 

Ten  codes  or  code  variants  form  the  basis  of  this  study.  The 
first  four  are  general  purpose  NLP  codes  which  were  selected  on  the 
basis  of  an  extensive  evaluation  of  NLP  codes  carried  out  under  another 
project  [12]. 
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1)  OPT  Is  a  generalized  reduced  gradient  code  which  employs  the 

Fletcher-Reeves  direction  updating  formula.  [13]  It  has  proven  to 
be  comparable  to  the  code  developed  by  Abadle  and  more  robust 
than  the  code  developed  by  Lasdon. 

11)  MAYNE  Is  a  conventional  Interior  penalty  function  method  which 
employs  the  OFP  updating  formula  for  the  unconstrained  search 
phase.  [14] 

111)  RALP  Is  a  linearization  based  algorithm  which  uses  successive 
linear  programming  subproblems  supplemented  with  Newton  type 
Iterations  to  maintain  constraint  feasibility.  [15] 

1v)  BIAS  Is  an  Implementation  of  a  variant  of  Hestenes'  Method  of 

Multipliers  developed  by  Schuldt  [16,  17]  to  accomodate  nonlinear 
Inequality  constraints.  Unconstrained  optimization  Is  carried 
out  by  means  of  the  DFP  algorithm. 

On  the  basis  of  the  studies  reviewed  in  the  previous  section,  the 
specialized  GP  codes  selected  for  use  in  the  present  work  were:  GGP, 

GPKTC ,  DAP  and  MCS.  In  addition,  a  promising  transformed  dual  code  not 
appearing  in  these  studies  was  also  chosen  in  order  to  be  able  to  generate 
comparative  data  with  that  GP  problem  formulation  [20] ,  Finally,  one  general 
purpose  NLP  code  modified  to  accept  the  special  features  of  the  convex 
primal  form  was  also  included.  Details  of  these  codes  follow: 

1)  BIAS-SV  is  a  variant  of  the  Method  of  Multipliers  specialized 
for  the  convexifled  GP  primal.  It  employs  a  modified  Newton 
method  for  the  unconstrained  optimization  phase  since  for  the 
convexifled  primal  functions  analytic  second  derivations  are 
readily calculatable.  BIAS  SV  further  exploits  this  property 
by  using  a  second  derivative  basedline  search.  [17] 
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11)  GPKTC ,  a  code  developed  by  Martens  and  Rijckaert  [18],  solves 

the  convexlfied  primal  by  Iterative  solution  of  the  Kuhn-Tucker  opti¬ 
mality  conditions  for  that  problem.  The  Iterations  follow 
essentially  the  Newton-Raphson  algorithm. 

Ill)  GGP  Is  a  code  developed  by  Dembo  [19]  which  also  solves  the 

convexlfied  primal  although  the  version  used  In  this  study  does 
not  fully  exploit  the  problem  structure.  The  code  Is  an  Implementation 
of  Kelley's  cutting  place  method,  a  venerable  and  well  known  convex 
programming  algorithm,  i  ;>  linear  subproblems  which  arise  In  this 
method  are  solved  using  the  dual  simplex  method  with  provisions 
for  upper  bounded  variables. 

1v)  MCS  Is  a  GP  specialization  of  the  convex  Simplex  Method  proposed  by 
Zangwlll.  Beck  and  Ecker  revised  the  conventional  direction 
generation  machinery  to  Insure  that  all  dual  variables  associated 
with  a  given  constraint  reach  zero  simultaneously.  The  code  also 
Includes  provisions  for  solving  subsidiary  maxmlmlzatlon  problems  If 
difficulties  In  recovering  primal  solutions  are  encountered.  [10] 
v)  QUADGP  Is  a  specialized  GP  code  developed  by  Bradley  [20]  which  solves 
the  transformed  dual  as  a  series  of  quadratic  programs.  Dynamically 
adjusted  lower  bounds  In  the  dual  variables  are  used  to  accomodate 
the  nondlfferentl ability  of  the  objective  function. 

vl)  DAP:  The  DAP  code  In  an  adaptation  of  the  Differential  Algorithm  of 
Belghtler  and  Wilde.  [2]  This  In  turn,  may  be  viewed  as  a  generalized 
reduced  gradient  technique  which  varies  one  variable  at  a  time 
and  uses  an  active  constraint  strategy  to  accomodate  Inequality 
constraints. 


4.2  Test  Problems 

Of  the  large  number  of  application  problems  available  In  the  literature. 
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some  42  prototype  GP  problem-  have  been  selected  for  use  In  this  study. 

About  half  of  these  problems  arise  from  engineering  applications,  the 
remainder  are  literature  test  problems.  Problem  references  are  given  In 
Appendix  8. 

The  problems  and  their  characteristic  dimensions  are  summarized  In 
Table  2.  From  this  table  It  Is  apparent  that  the  test  problems  cover  the 
following  wide  range  of  problem  dimensions: 

2  <  Primal  Variables  <  30 
8  <  Primal  Terms  <  197 

1  £  Number  of  Constraints  <  73 
3.3*  Exponent  matrix  density  <_  831 

The  lower  limit  on  density  Is  not  as  low  as  might  be  desirable. 

However,  It  should  be  noted  that  the  lower  limit  of  problem  density  Is 
limited  by  the  number  of  primal  variables.  This  comes  about  because  the 
sparsest  possible  problem  Involving  N  variables  and  T  terms  will  be  the  one 
In  which  each  term  contains  only  a  single  variable  (as,  for  example,  In  a 
linear  programming  problem).  Thus  the  lower  limit  to  the  density  of  the 
exponent  matrix  will  be, 

-V  .  i 

NXt  N 

It  would  be  desirable  to  Include  large  and  sparse  GP  problems  In  this 
study.  However,  there  are  only  one  or  two  posynomlal  problems  with  more 
than  thirty  variables  which  have,  to  our  knowledge,  appeared  In  the  literature. 
Hence  we  have  restricted  our  range  of  Investigation  to  problems  with  N  <  30 
and  1  Density  >  3.31. 

4.3  Starting  Point  Generation 

One  of  the  key  elements  In  comparative  numerical  studies  Is  the 
selection  of  starting  points  for  each  problem.  In  this  study  primal  and 
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dual  starting  points  for  each  >blem  were  generated  randomly  by  sampling  from 


the  surface  of  an  N-dlmensional  sphere  whose  center  Is  the  actual  optimal 
solution  to  the  problem.  The  choice  of  radius  Is  arbitrary;  In  general,  a 
reasonably  large  value  was  selected  so  that  generation  of  points  close  to  the 
optimum  was  avoided.  The  points  generated  were  tested  for  feasibility  and  only 
feasible  points  retained.  Typically,  two  different  radii  were  used  and  some 
10  points  retained  for  each  radius  and  for  each  problem.  In  some  cases  the 
feasible  region  was  so  tightly  constrained  that  It  was  not  possible  to  generate 
multiple  and  sufficiently  distinct  starting  points,  even  after  thousands  of 
trials.  The  same  primal  points  suitably  transformed  were  used  in  the  convex 
primal  and  transformed  primal  computations.  A  similar  starting  point  proce¬ 
dure  generation  was  employed  for  dual  and  transformed  dual  starting  points. 

In  this  case,  the  sign  unrestricted  transformed  dual  variables  were  randomly 
sampled  and  the  transformed  dual  constraints  were  checked  for  feasibility. 

The  need  for  multiple  starting  points  cannot  be  overstated.  As  can 
be  seen  from  Table  3,  the  variation  In  solution  times,  obtained  for  problem 
13  using  OPT  started  from  10  different  points,  can  be  considerable.  For 
instance  for  primal  solution  the  range  of  times  Is  from  1.776  secs  to  5.72 
secs  with  a  mean  of  3.65  and  standard  deviation  of  1.42.  Similarly,  for 
convex  primal  solution  the  range  Is  from  0.83  to  1.1  secs  with  mean  of  0.878 
and  standard  deviation  of  0.165. 

Note  that  for  a  given  starting  point  the  ratio  of  primal  to  convex 
primal  solution  times  changes  substantially.  For  Instance,  It  Is  1.8  for 
starting  point  5  and  8.3  for  starting  point  8.  Yet  these  computation  times 
are  obtained  using  the  same  code  with  Identical  termination  parameters. 

A  similar  although  less  pronounced  variation  can  be  noted  when  the  OPT 
convexlfled  primal  solution  times  are  compared  to  those  obtained  with  the 
66P  program.  The  solution  time  ratio  ranges  from  0.53  for  problem  8  to 
1.0  for  problem  10. 
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These  results  Indicate  that  code  ranking  based  on  performance  with 
a  single  starting  point,  as  is  commonly  done  in  the  literature,  is  a  very 
questionable  procedure.  If  at  all  possible,  a  sufficiently  large  number  of 
points  must  be  used  so  that  reliable  means  and  standard  deviations  can  be 
computed.  Comparisons  must  then  be  made  via  statistical  tests  such  as 
those  of  Student. 

The  obvious  difficulty  with  multiple  starting  points  is  the  tremendous 
Increase  in  computational  effort.  The  testing  carried  out  in  the  present 
report  required  some  10,000  separate  test  runs  of  which  some  6,000  resulted 
In  useful  data. 

4.4  Test  Procedure 

To  carry  out  code  tests  on  this  scale  it  is  Imperative  that  the  assembly, 
execution,  and  analysis  of  runs  be  automated  as  much  as  possible.  In  the  present 
study  we  found  it  convenient  to  prepare  computer  files  of  test  problem 
subroutines  and  test  problem  starting  points  for  each  of  the  five  GP  problem 
formulations.  These  files  are  accessed  through  an  executive  program  which 
calls  the  desired  routines,  retrieves  the  required  starting  point  data,  executes 
the  test  run,  and  saves  the  Intermediate  and  final  results  of  each  run  In 
appropriate  result  files.  The  result  files  are  separately  analyzed  by  a  data 
post-processing  program  which  calculates  the  desired  error  functions,  performs 
error  function  Interpolations,  computes  means  and  standard  deviations  for 
each  code- formulation-test  problem  combination  at  several  error  levels. 

The  primary  error  function  used  In  this  study  is  the  pseudo-Lagranglan 
function. 
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The  starred  quantities  In  this  expression  are  the  known  optimal  values  of 
the  problem  functions  and  Lagrange  Multipliers.  The  multipliers  were  obtained 
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by  a  direct  solution  of  the  ontv  lity  conditions  at  x  using  a 
linear  equation  solver.  The  sum  in  the  above  expression  is  only 

over  those  constraints  which  are  active  at  the  optimum 
solution.  Either  because  Imposed  constraint  tolerances  effectively  allowed 

slight  constraint  relaxations  or  because  the  algorithms  themselves  generated 

primal  exterior  points,  all  of  the  codes  tested  except  MAYNE  would  produce 

solutions  with  slight  infeasibilities.  The  relative  error  function  defined 

above  allowed  a  correction  to  be  applied  to  the  objective  function  errors 

when  slightly  Infeasible  points  are  generated.  Values  of  this  error  function 

were  computed  for  the  Intermediate  iteration  points  recorded  during  each  run. 

The  Intermediate  solution  t?ffl€i  (which  excluded  all  I/O  time  required  for 

recording  test  data)  and  error  function  values  were  fitted  to  polynomials 

and  these  used  as  Interpolating  functions  to  determine  solution  times  at 

specified  error  furctloi  *«rels.  Mean  solution  times  and  standard  deviations 

were  tabulated  for  each  problem/code  or  formulation  combination  at  relative 
-2  -3  -4 

error  levels  of  10  ,10  ,10  ,  for  all  successful  runs  and  at  termination 

for  all  runs. 

Each  code  was  run  with  a  single  fixed  set  of  program  parameters,  the 
values  of  which  are  given  In  Appendix  A.  These  parameters  were  selected  In 

_4 

advance  by  experimentation  so  that  a  relative  error  of  at  least  10  could 

beattalnedon  trial  runs  with  a  few  moderately  sized  problems.  In  many  cases 

the  program  parameters  correspond  to  values  recommended  by  the  program  author. 

No  readjustment  of  program  parameters  were  undertaken  during  the  main  test  runs. 

-4 

As  a  result,  some  runs  did  not  achieve  error  levels  of  10  Similarly,  only  a 
minimum  of  program  parameter  retuning  was  undertaken  If  the  run  failed  to  make 
any  progress.  The  decision  to  avoid  extensive  parameter  retuning  resulted  in  gaps 
In  the  solution  time  data.  However,  because  of  the  large  number  of  test 
problems  used,  we  believe  these  gaps  do  not  seriously  affect  the  conclusions  of 
the  study. 


5.  Results 

An  overall  summary  of  the  number  of  problems  and  number  of  runs  attempted 
with  each  code- formulation  pair  is  given  in  Table  4.  As  shown  all  problems 
were  not  run  with  each  code.  For  some  of  the  larger  problems  some  of  the 
codes  required  in  excess  of  150K  to  load  and  hence  could  not  be  run  under  the 
normal  priority  system  used  with  the  CJC6500  at  Purdue  University.  Problem 
42  had  to  be  excluded  from  the  study  primarily  for  that  reason.  In  other 
cases,  particularly  the  direct  primal  runs,  the  trend  was  sufficiently  obvious 
that  runs  with  larger  problems  or  with  the  complete  set  of  starting  points 
was  not  deemed  necessary.  This  was  particularly  the  case  with  the  direct 
primal  runs,  the  OPT  transformed  primal  runs,  and  the  BIAS-SV  runs.  Finally, 
in  some  cases,  particularly  the  QUADGP  run,  the  differences  In  the  solution 
times  between  the  starting  points  for  a  given  problem  were  sufficiently  small, 
that  the  number  of  points  used  per  problem  could  be  substantially  reduced. 

Even  with  these  economies,  the  number  of  runs  which  were  ultimately  counted 
in  the  study  were  nearly  6,000. 

As  can  be  seen  from  the  last  column  of  Table  4,  the  percentage  of 

unsuccessful  runs,  defined  as  the  number  of  attempted  runs  that  failed 
to  achieve  any  significant  progress  away  from  the  starting  point,  varied 
quite  substantially.  The  conventional  NLP  codes  RALP  and  MAYNE  seemed 
to  be  particularly  prone  to  failure.  The  solution  of  the  transformed  primal 
using  OPT  was  also  unreliable,  presumeably  because  of  difficulties  caused  by 
the  large  number  of  constraints  which  are  required  by  the  transformed  primal 
formulations.  Most  surprising  was  the  erratic  performance  of  GPKTC  which,  at 
times  produced  extremely  fast  solutions  but  In  other  cases  failed 
completely.  Since  GPKTC  basically  uses  the  Newton 
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Raphsrn  equation  solving  algorithm,  this  erratic  performance  may  well  simply 
reflect  the  often  reported  sensitivity  of  this  algorithm  to  Initial 
estimates.  Similarly  surprising  is  the  high  number  of  failures  of  the  special 
version  of  BIAS,  especially  in  view  of  the  high  reliability  of  the  regular 
version  of  BIAS.  Both  solved  the  convexified  form  of  the  primal:  the  former 
used  a  modified  Newton  algorithm  with  analytic  derivatives;  the  latter  a  DFP 
algorithm  with  numerical  derivatives.  The  most  reliable  performance  seems  to 
have  been  achieved  by  the  general  r;L'  codes  OPT  and  BIAS  when  applied  to 
the  convexified  primal  formulation.  The  next  best  performance  was  attained 
by  the  specialized  codes  GGP  and  DAP. 

In  order  to  facilitate  the  presentation  of  the  more  detailed  test  data 
we  will  aggregate  these  results  into  several  series: 

1)  Comparison  of  solution  times  of  various  algorithms  for  a  given  GP 
problem  formulation. 

2)  Cross-comparison  of  solution  times  for  the  various  formulations  all 
solved  using  the  same  algorithm. 

3)  Cross-comparisons  of  the  most  successful  algorithms  found  for  each 
GP  formulation  type. 

4)  Examination  of  how  solution  time  varies  with  problem  characteristic 
dimensions  for  each  of  the  various  formulations. 

The  data  reported  In  Tables  5  through  12  is  all  based  only  on  the 
successful  runs.  Moreover,  the  solution  time  for  all  runs  of  problems  15  had  to 
be  excluded  because  of  errors  introduced  during  post  processing  of  the  results. 
5.1  Intra- formulation  Comparisons 

This  series  of  runs  consists  of  primal,  convex  primal,  transformed  primal 
and  dual  comparisons.  Tables  5A,  B,  and  C  give  mean  solution  times  at 
relative  error  levels  of  10  10  and  10  respectively,  obtained  using 
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the  codes  OPT,  BIAS,  MAYNE  and  RALP  to  solve  the  primal  directly.  Each 

column  of  results  also  indicates  the  number  of  successful  runs  upon  which 

themean  is  based.  From  Tables  5A,  B,  and  C  it  is  clear,  even  without  statistical 

testing,  that  OPT  is  generally  faster  than  the  other  codes^yielding  solution 

times  less  than  1/2  of  the  next  best  competitor's  in  the  majority  of  cases: 

20  of  35  at  the  10"2  level,  17  of  29  at  the  10“3,  and  13  of  21  at  the  10‘4. 

Note  that  quite  a  high  proportion  of  the  direct  primal  attempts  failed  to 

_2 

advance  the  starting  points  to  even  -e  10  relative  error  level. 

The  general  results  are  quite  in  agreement  with  the  conclusions  of  the 
general  NLP  code  comparison  recently  completed  by  Sandgren  [  1],  in  which 
the  GRG  based  codes  outperformed  all  other  algorithms,  including  MAYNE, 

.  RALP,  and  BIAS. 

The  corresponding  comparisons  involving  solution  of  the  convex  primal 
are  shown  in  Tables  6A,  B,  and  C.  The  codes  involved  in  this  comparison 
are:  the  general  NLP  codes  OPT,  BIAS,  and  RALP;  the  version  of  BIAS 
specialized  for  GP's,  and  the  specialized  GP  programs  GGP  and  GPKTC. 

Again  the  general  purpose  GRG  code  dominates  the  others  in  mean  solution 
times  at  all  three  error  levels.  Based  on  mean  times  GGP  is  second  and 
GPKTC  third.  However,  in  this  series  of  runs  there  is  less  difference 
between  the  means  and,  hence,  statistical  testing  is  necessary  to  provide 
a  more  definitive  ranking.  It  Is  clear,  however,  that  overall  OPT  is  at 
least  as  effective  as  the  specialized  programs  GGP  and  GPKTC.  This  in 
Itself  Is  quite  surprising  in  view  of  the  fact  that  the  latter  two  codes 
are  specially  designed  for  polynomial  problems  and  use  analytic  derivatives 
rather  than  difference  approximations  as  does  OPT.  It  should  be  noted  that 
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the  version  of  GGP  used  in  these  tests  performs  some  unnecessary  computations 
whose  exclusion  would  have  somewhat  reduced  the  GGP  solution  times.  In 
setting  up  each  new  linear  subproblem  a  conversion  from  the  z  to  the  x  space 
is  made,  the  original  constraints  are  evaluated  In  the  x  space,  the  cut  Is 
generated,  and  the  subproblem  is  reconverted  to  the  z  space  for  solution. 
Timing  estimates  have  shown  that  depending  upon  the  problem  characteristics 
6  to  16%  savings  in  CPU  time  could  have  been  attained  if  all  calculations 
had  been  performed  in  only  the  z  space.  Such  mean  CUP  time  reductions  would 
not,  however,  substantively  affect  the  observed  comparisons. 

The  transformed  primal  results  summarized  in  Table  7  indicate  quite 
clearly  that  the  specialized  algorithm  DAP  is  faster:  of  eighteen  problems 
for  which  solution  times  are  available  for  both,  DAP  has  solution  times  1/2  or 
less  those  of  OPT  in  11  cases.  OPT  predominated  in  only  4  cases  by 
the  same  margin.  In  the  remaining  three  cases  the  mean  times  were  too  close 
to  differentiate  without  statistical  tests.  This  performance  is  as  might  be 
anticipated,  since  in  the  OPT  version  used,  the  T-N  tranformed  primal  linear 
equality  constraints  are  not  accorded  special  handling.  Moreover,  the 
transformed  single  term  constraints 

9|c(w)  =  exp(wt)  <  1 

are  not  simplified  to  the  form,  <_  0,  which  would  allow  implicit  rather 
than  explicit  handling  of  such  constraints.  Both  of  these  structural 
features  are  exploited  in  DAP.  However,  it  is  interesting  to  note  that  the 
differences  in  the  solution  times  decrease  (e.g.  problem  1,  2,  11,  12,  13, 

20,  25)  or  occassionally  are  reversed  at  the  higher  accuracy  level  (e.g. 
problem  16).  This  indicatesthat  the  GRG  constraint  adjustment  strategy 
employing  Newton’s  method  is  more  efficient  than  the  line  search  based 
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methods  used  In  OAP.  Since  both  algorithms  essentially  employ  a  similar 
direction  generation  method  (the  reduced  gradient),  it  Is  thus  likely  that 
a  specialized  OPT  transformed  primal  version  will  obtain  a  superior  performance 
to  that  obtained  by  DAP. 

Separate  dual  and  transformed  dual  intra- formulation  comparisons  were 

not  carried  out  as  part  of  this  study.  Earlier  work,  cited  in  Section  3, 

indicated  that  the  dual  based  MCS  algorithm  was  preferrable  to  a  variety  of  other 

dual  and  transformed  dual  approaches.  A  comparison  of  MCS  solution  times 

with  those  obtained  using  QUADGP,  which  solves  the  transformed  dual,  is 

shown  in  Table  8.  Using  a  2  to  1  time  ratio  as  being  significantly  different, 

_2 

QUADGP  is  clearly  superior,  at  the  10  error  level,  in  23  of  32  cases 

_3 

'  with  MCS  being  superior  in  only  5  cases.  However,  at  the  10  level  this 
slips  to  15  vs  10  and  at  the  10~^  level  to  11  vs  14.  Tnis  swing  is  largely 
due  to  the  fact  that  QUADGP  failed  to  solve  problems  to  the  lower  error  tolerances. 

Thus  Table  8  tends  to  confirm  the  conclusions  obtained  in  earlier  studies 
about  the  general  robustness  of  MCS. 

The  intra-formulation  comparisons  thus  indicate  that  OPT  is  the  most 
effective  for  both  primal  and  convex  primal  solution  with  GGP  a  convex 
primal  second.  The  specialized  code  DAP  is  better  than  OPT  for  the  transformed 
primal  formulation.  Intra- formulation  comparisons  are  not  given  for  the 
dual  and  transformed  dual. 

5.2  Intra-formulation  Comparison  Using  the  Same  Code 

In  order  to  elucidate  which  primal  form  is  most  efficiently  solved, 
we  present  a  comparison  of  solution  times  for  the  primal  formulations  when 
the  same  code  is  used  for  each  formulation.  Relative  times  are  given  for 
OPT  in  Table  9  and  for  BIAS  in  Table  10. 
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From  the  OPT  and  BIAS  prioji  to  convex  primal  ratios,  it  is  obvious 

that  the  primal  times  are  almost  always  larger  by  at  least  a  factor  of  two. 

This  indicates  quite  clearly  that  all  of  the  differences  reported  by  Dembo 

[4]  between  the  best  NLP  solution  times  and  the  best  specialized  GP  solution 

times  is  due  to  the  fact  that  the  NLP  codes  (several  of  which  were  GRG 

codes,  as  is  OPT)  solved  the  primal  and  the  best  specialized  codes  (GGp  and 

GPKTC)  solved  the  convex  primal.  A  significant  portion  of  the  difference 

in  solution  times  appears  to  be  due  to  differences  in  function  evaluation 

times.  Evaluation  of  the  term  Tlx  is  carried  out  on  the  machine  using 

n 

logarithms,  summing  the  results,  and  taking  anti-logarithms.  The  term 
exp(Eant  zn),  on  the  other  hand,  can  be  carried  out  via  a  simple  sum  and  a 
single  exponentiation.  The  former  is  much  more  time  consuming.  We  have 
observed  numerous  BIAS  runs  in  which  objective  and  constraint  function  values 
at  the  successive  unconstrained  optimization  stages  as  well  as  the  actual 
number  of  functional  evaluations  taken  were  nearly  identical  for  both  the 
primal  and  the  convex  primal  iterations  of  a  given  problem:  yet,  the  solution 
times  were  very  much  different. 

A  second  commonly  cited  difficulty  with  GP  primals  is  scaling,  that  is, 
both  the  sensitivities  of  the  various  problem  functions  with  ;'e«,*nict  to 
variable  changes  are  substantially  different  as  well  as  the  sensitivities  of 
any  given  function  with  respect  to  different  variables  varies  substantially. 
Undoubtedly,  the  favorable  scaling  introduced  by  the  transformation  zn=ln(xn) 

Is  reflected  in  the  primal  to  convex  primal  solution  ratios.  However, 

In  our  experience  GRG  codes  are  less  sensitive  to  scaling  than  other  NLP 
algorithms;  while  the  version  of  BIAS  employed  In  our  tests  incorporate 
automatic  scaling  of  both  constraints  and  variables  based  on  the  composite 
Jacobian.  Thus,  we  can  not  on  the  basis  of  our  results  conclude  to  what 
extent  scaling  is  a  factor. 
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In  comparing  the  convex  and  transformed  primal  results,  the  main  difference 
In  solution  times  can  be  explained  In  terms  of  a  trade-off  between  number  of 
variables  and  constraints  and  the  reduction  of  variable  Interactions  In  the 
non-linear  functions.  Since  for  any  problem  T>N,  the  transformed  primal 
always  has  higher  dimensionality  than  the  convex  primal.  Moreover,  while  both 
formulations  always  have  the  same  number  of  non-linear  constraints,  the  trans¬ 
formed  primal  will  in  addition  have  T-N  linear  equality  constraints.  When 
T-N  is  small,  as  in  problem  8,  then  solution  times  are  close.  However,  when 
T-N  is  large  as  in  problem  12,  then  the  solution  times  are  substantially 
different.  Because  problem  dimensionality  will  be  shown  to  be  the  predominant 
variable  in  determining  problem  solution  time,  it  seems  unlikely  that  solution 
via  transformed  primal  can  be  made  significantly  more  efficient  than  convex 
primal  solution,  even  if  special  provisions  are  made  for  the  T-N  linear 
equality  constraints. 

Finally,  it  is  of  interest  to  note  from  Table  10,  that  the  special  GP 

version  of  BIAS  which  uses  analytic  second  derivations  for  unconstrained 

optimization  and  line  searching  is  considerably  slower  than  the  normal 

BIAS  code  when  both  solve  the  convex  primal  form.  This  is  particularly 

noticeable  as  problem  size  increases.  There  is  to  be  sure  some  reduction  in 

-2  -3 

the  time  ratio  in  going  from  the  10  to  the  10  error  level,  reflecting 
the  expected  faster  convergence  rate  of  the  modified  Newton  algorithm. 

However,  the  computational  time  required  to  evaluate  the  second  derivatives 
apparently  is  not  balanced  by  increased  efficiency  in  the  search.  This 
finding  is  consistent  with  the  results  reported  by  Sarma,  et.  al .  [9]  in 
which  a  primal  approach  using  analytical  second  derivatives  was  found 
to  be  quite  inefficient. 


5.3  Intra-Formulation  Comparison  sing  Different  Codes 


23 


Finally,  we  compare  the  solution  times  for  the  various  formulations 
when  each  Is  solved  using  the  code  shown  to  be  the  most  effective  for  that 
formulation.  Tables  11A,  B,  and  C  summarize  the  mean  times  for  the  best 
primal  (OPT),  convex  primal  (OPT),  transformed  primal  (DAP),  dual  (MCS), 
and  transformed  dual  (QUADGP)  co^es.  The  mean  times  for  GGP  are  also  included 
because  they  were  sufficiently  close  to  those  of  OPT.  As  can  be  seen  from 
these  tables  for  any  given  problem  the  mean  solution  times  of  the  two  fastest 
codes  often  differ  by  less  than  a  factor  of  two.  Moreover,  as  can  be  seen 
from  Table  12,  the  standard  deviations  of  the  means  frequently  are  quite 
substantial.  Thus  comparisons  of  the  mean  solution  times  necessitate  the 
application  of  statistical  tests. 

Assuming  that  the  solution  times  x  and  y  of  two  codes  for  any  given 

problem  are  normally  distributed  variables  each  with  their  own 
2  2 

variances  o  and  a  ,  then  code  solution  time  comparison 
a  y 

Is  equivalent  to  the  problem  of  testing  whether  the  true  mean  solution 

times,  Mx  and  M^,  of  the  two  codes  for  the  given  problem  are  equal.  This 

is  the  Behrens- Fisher  problem  of  statistics  [2l].  It  can  be  shown  that 
2  2 

IF  sx  an(*  sy  are  un^ase(*  sample  estimates  of  the  variances,  then 

the  variable 


,  (x-y)  -  (Mx-My) 

<sx/  *  sy/  )  '/2 

"x  y 


will  possess  an  approximate  student  t  distribution  with  degree  of  freedom 


"x  ♦  1  njr  *  1 


V 
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In  these  expressions,  x  an>  y,  are  the  sample  means  and  n  and  n  are 

*  y 

the  sizes  of  the  two  samples.  Il.ese  formulas  were  applied  to  test  the 

difference  in  the  means  of  the  solution  times  given  in  Tables  1 1 A ,  B,  and 

_2 

C.  Sample  results  for  the  10  error  level  are  given  in  Table  13.  The 

Student  t  value  was  calculated  using  the  means  given  in  Table  1 1 A  and 

standard  deviations  given  in  Table  12.  The  significance  level  of  the 
differences  in  the  means  can  be  determined  using  standard  tables  of  the 
Student  t  distribution  [21,  Appendix  2].  These  significance  levels  are 
given  in  the  last  column  of  Table  13  for  those  means  which  were  based 
on  at  least  three  runs.  As  can  be  seen  from  the  Table,  for  several  problems, 
e.g.  problem  2,  the  means  were  not  significantly  different.  In  the  case 
of  problem  2,  it  was  necessary  to  proceed  to  the  fourth  best  mean  time 

before  a  significant  statistical  difference  from  the  best  mean  time  could 
be  established. 

These  calculations  were  repeated  at  the  10"3  and  10-4  relative  error 
levels.  The  results  were  used  to  determine  the  number  of  problems  for 
which  each  code  achieved  the  best  or  second  best  solution  times.  An  90X 
significance  level  was  required  before  means  were  considered  to  be  different. 

In  the  case  of  differences  below  that  significance  level,  both  codes  were 
ranked  equally.  The  results  of  this  ranking  are  shown  in  Table  14.  It 
Is  quite  clear  that  OPT  applied  to  the  convex  primal  is  the  best  GP  solution 
approach  overall.  At  the  highest  error  level  of  10'2,  DAP  and  QUADGP  are  competitive 
However,  at  lower  error  levels  these  two  codes  fade  out  to  be  decisively 


overtaken  by  MCS  at  the  10  4  level.  The  better  ranking  of  MCS  at  the  10~4 
error  level,  however.  Is  largely  a  result  of  its  robustness  rather  than  its 
speed.  In  9  out  of  13  cases  In  which  it  is  first,  it  Is  the  only  code 
to  solve  the  problem  to  that  accuracy  level  and  in  several  of  those 
Instances  the  solution  times  exceed  50  sec.,  a  very  large  time  within  the 
framework  of  this  study. 


25 


In  general,  the  dual  based  odes  are  only  competitive  with  the 
convex  primal  solution  methods  hen  T-N  is  small  and  when  the  multi-term 
constraints  are  active  at  the  optimum  (eg.  problems  2,  8,  13,  16,  32,  and 
34).  The  specialized  codes,  GGP,  DAP,  as  well  as  GPKTC, overall  do  not 
appear  competitive  with  OPT.  Quite  clearly  the  successes  of  GGP  and  GPKTC 
against  other  GP  solution  approaches,  as  reported  in  several  recent 
comparative  studies  [5,  7,  and  9]  are  largely  due  to  the  fact  that  these 
codes  are  based  on  the  convex  primal  formulation  rather  any  insights 
offered  by  GP  theory.  Thus  these  results  do  cast  doubts  on  the  computational 

significance  of  many  years  of  research  into  non-zero  degree  of  difficulty, 
prototype  GP  solution  algorithms. 

It  should  be  noted  that  significant  Improvements  in  the  performance 
of  OPT  would  in  all  likelihood  be  achieved  if  some  structural  features 
of  the  convex  primal  are  exploited.  For  instance,  single  term  constraints 
need  not  be  treated  as  normal  constraints  but  can  be  converted  to  linear 
Inequality  constraints.  Also,  computation  of  derivatives  could  be  made 
much  more  efficient  by  saving  the  term  values  for  each  posynomial  during 
function  evaluation  and  then  calculating  the  partial  derivatives  analytically 
as  a  simple  weighted  sum  of  these  term  values,  i.e., 

M. .  s  *„t  >ct «*  V'n>l 

n 

where  the  quantities  in  brackets  are  the  already  calculated  term  values. 

In  OPT  derivatives  are  calculated  numerically  by  differences  and  single 
term  constraints  are  treated  as  explicit  nonlinear  Inequality  constraints. 

5.4  Effect  of  Problem  Dimensions  on  Solution  Time 

The  remaining  objective  of  this  study  was  to  attempt  to  deduce  which 
characteristic  dimensions  of  a  prototype  GP  problem  could  best  be  used  as  a 
measure  of  solution  difficulty.  To  that  end  pairwise  correlation  coefficients 
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were  computed  between  solution  .  fflculty  as  measured  by  mean  solution  time 
and  seven  different,  but  not  necessarily  Independent,  problem  characteristic 
dimensions.  For  purposes  of  these  computations  the  total  solution  time 
to  termination  of  a  run  was  used  rather  than  the  solution  time  to  a  specified 
relative  error  tolerance.  This  Is  appropriate  because  the  runs  used  to 
calculated  a  given  correlation  coefficient  all  Involve  the  same  code  run 
with  the  same  set  of  program  parameters. 

The  results  for  two  types  of  assumed  relationships  are  given  in 
Tables  15A  and  15B.  Table  15A  contains  the  correlation  coefficients 
obtained  by  assuming  that  solution  time  is  proportional  to  an  exponential 
function  of  the  particular  problems  characteristic,  that  Is, 

time  a  by 

where  y  Is  the  problem  characteristic  such  as  number  of  variables,  number 
of  constraints,  etc.  Table  15B  gives  the  correlation  coefficients  when  a 
linear  relationship  is  assumed.  For  comparative  purposes,  the  last  column 
of  the  tables  lists  the  critical  value  of  the  correlation  coefficient  for 
a  0.05  significance  level  ([21],  p.  167). 

For  the  primal  solution  approach  (OPT-P)  the  solution  time  correlates 
most  strongly  to  the  exponential  of  the  number  of  the  number  of  primal 
variables.  However,  significant  linear  correlation  also  exists  with  the 
number  of  constraints  and  the  degree  of  difficulty.  Note  that  the  degree 
of  difficulty  correlates  better  than  either  the  number  of  terms  or  the  number 
of  primal  variables  separately.  Also  the  number  of  constraints  correlates 
fl?  more  strongly  than  either  the  number  of  multi-term  constraints  or  the  number  of 
tight  constraints.  The  dependence  on  the  exponential  of  the  number  of  variables 
and  the  less  than  exponential  dependence  on  the  total  number  of  constraints 
Is  as  might  be  expected  for  a  GRG  code.  The  correlation  to  degree  of 
difficulty,  on  the  other  hand.  Is  a  GP  problem  characteristic  which  probably 
reflects  the  time  required  to  evaluate  the  problem  functions. 
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For  the  convex  primal  solution  approaches  (OPT-CP,  GGP,  and  GPKTC)  the 
situation  is  less  coherent.  The  strongest  exponentially  correlated  variable 
seems  to  be  the  number  of  primal  terms  both  for  GPKTC  and  for  OPT.  For  both 
the  correlation  coefficient  is  higher  for  primal  terms  than  for  either  primal 
variables  or  degree  of  difficulty.  In  the  case  of  GGP,  however,  the  number 

of  primal  variables  shows  a  higher  correlation.  The  strongest  linear 
correlation  appears  to  involve  the  degree  of  difficulty  for  GGP  and  GPKTC 
but  the  number  of  constraints  for  OPT.  Apparently  the  differences  in  the 
operations  of  the  algorithms  used  to  ,olve  the  convex  primal  serve  to 
obscure  the  trends.  Nonetheless,  it  is  clear  that  the  number  of  primal 
variables  becomes  less  significant  and  the  number  of  primal  terms  as  well 
as  the  density  more  important  in  going  from  the  primal  to  the  convex  primal. 

In  the  transformed  primal  case,  the  exponential  dependence  on  the  number 
of  primal  terms  becomes  even  more  pronounced.  This  is  to  be  expected  since 
for  the  transformed  primal  the  latter  becomes  equal  to  the  number  of  problem 
variables.  The  linear  dependence  on  the  number  of  multi- term  constraints 
becomes  more  pronounced  because  the  effect  of  the  single  term  constraints 
is  minimized  since  they  are  uncoupled  as  a  result  of  the  problem  transformation. 

In  the  case  of  the  dual  approaches,  the  most  significant  correlation 
Is  found  to  the  exponential  of  the  degree  of  difficulty  for  the  transformed 
dual  (QUADGP)  and  to  the  exponential  of  the  number  of  primal  terms  for 
the  dual  (MCS).  This  is  consistent  since  these  quantities  correspond  to 
the  number  of  variables  in  these  formulations.  Strong  linear  correlation 
is  shown  to  the  number  of  primal  multi-term  constraints  -  significantly 
stronger  than  to  either  the  total  number  of  constraints  or  to  the  number 
of  tight  constraints.  Apparently,  this  reflects  the  overhead  of  having 
to  deal  with  the  variables  in  the  problem  formulations,  regardless  of 
whether  or  not  these  vanish.  Curiously  the  density  of  the  exponent  matrix 
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shows  no  significant  correlate  for  either  the  dual  approaches  or  the 
transformed  primal  approaches,  but  does  show  a  reverse  correlation  In  the 
primal  and  convex  primal  cases.  The  density  correlation  In  the  primal 
case  Is  probably  spurious  since  it  Is  unlikely  that  primal  computation 
time  will  decrease  with  increased  density  for  problems  of  the  same 
dimensionality.  After  all,  in  the  primal  case,  density  reflects  the 
degree  of  coupling  of  the  program  variables.  Most  likely  the  reverse 
correlation  is  induced  because  of  the  basically  inverse  relationship 
between  density  and  number  of  primal  variables  noted  in  Section  4.2.  He 
are  thus  led  to  conclude  that  density  does  not  appear  to  be  a  reliable 
primary  Indication  of  problem  difficulty. 

In  summary,  in  all  cases  the  key  exponentially  correlated  problem 
characteristic  appears  to  be  the  number  of  variables  in  the  problem 
formulation.  In  going  from  primal  to  convex  primal  to  transformed  primal 
to  dual,  the  key  linearly  correlated  problem  characteristic  shifts  from 
number  of  constraints  to  number  of  multi-term  constraints.  Number  of 
tight  primal  constraints  is  in  all  cases  only  a  secondary  factor.  Density 
of  the  exponent  matrix  does  not  appear  to  be  a  reliable  primary  Indicator 
of  problem  difficulty  as  measured  in  solution  time. 

6.  Conclusions 

Within  the  limits  of  the  experimental  design  of  this  study,  a  key 
feature  of  which  is  the  use  of  fixed  code  parameters,  the  following 
overall  conclusions  may  be  drawn: 

1)  the  convex  primal  is  inherently  the  most  advantageous 
formulation  for  solution. 

11)  '  *  general  purpose  GRG  code  applied  to  the  convex  primal  Is 
competitive  with  the  reputedly  best  specialized  GP  codes 
currently  available. 
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111)  the  differences  between  the  primal  and  convex  primal  formulations 
lie  mainly  In  scaling  and  function  evaluation  time. 

1v)  transformed  primal  solution  approaches  are  not  likely  to  lead 
to  more  efficient  GP  solution  than  the  convex  primal 
v)  the  dual  approaches  are  only  likely  to  be  competitive  for  small 
degree  of  difficulty,  tightly  constrained  problems. 

vi)  posynomial  GP  problem  dir,'iculty  as  measured  in  solution  time 
Is  best  correlated  to  an  exponential  of  the  number  of  variables 
In  the  formulation  being  solved  and  Is  proportional  to  the 
total  number  of  multi-term  primal  constraints. 
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TABLE  1 :  I !  .  LEM  CHARACTERISTICS 


No.  of  Variables 

Primal 

N 

Convex 

Primal 

N 

Transformed 

Primal 

Dual 

T(+k) 

Transformed 

Dual 

T-N-l 

No.  of  Constraints 

LINEAR  EQUALITY 

- 

- 

T-N 

N+K+K) 

- 

LINEAR  INEQUALITY 

- 

- 

- 

- 

T 

NON-LINEAR  INEQUALITY 

K 

K 

K 

— 

- 

Sign  restriction  on 

Yes 

No 

No 

Yes 

No 

VARIABLES 

Problem  Convex  x 
(concave) 

No 

Yes 

Yes 

Yes 

Yes 

Problem  separable 

r to 

No 

Yes 

No(Yes) 

No 

Table  2.  Posynomial  Test  Problems  and  Their  Characteristics 


>1 
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Table  3.  The  Effect  of  Starting  Points  on  Solution  Times 


Starting 
Point 
(R  =  .5) 

OPT 

Primal 

(sec) 

OPT  P. 

OPT  C.P. 

OPT 

Convex i tied 
Primal 
(sec) 

OPT  C.P. 

GGP 

GGP 

(sec) 

1 

2.991 

2.7 

1.094 

.87 

1.253 

2 

4.224 

6.2 

.684 

.58 

1.174 

3 

2.161 

2.8 

.770 

.58 

1.335 

4 

3.323 

4.4 

.748 

.58 

1.296 

5 

1.776 

1.8 

.995 

.87 

1.141 

6 

2.115 

2.6 

.824 

.63 

1.305 

7 

4.309 

4.1 

1.045 

.68 

1.535 

8 

5.673 

m 

• 

CO 

.683 

.53 

1.298 

9 

5.722 

6.8 

.837 

.65 

1.320 

10 

4.214 

3.8 

1.100 

1.00 

1.104 

Table  4.  Number  of  Sol  r.ions  Attempted  and  Solved 


Code 

Problems 

Attempted 

Runs 

Attempted 

Runs 

Failed 

%  Unsuccessful 
Attempts 

OPT-P 

40 

399 

27 

6.77 

OPT-CP 

41 

616 

1 

0.16 

OPT-TP 

25 

452 

124 

27.43 

GGP 

41 

598 

24 

4.01 

GPKTC 

39 

589 

240 

40.75 

MAYNE 

31 

379 

61 

16.09 

RALP-P 

34 

446 

146 

32.74 

RALP-CP 

37 

552 

115 

*  20.83 

BIAS-P 

39 

260 

1 

0.38 

BIAS-CP 

40 

457 

0 

0.0 

BIAS-SV 

29 

166 

21 

12.65 

MCS 

26 

412 

60 

14.56 

DAP 

40 

406 

14 

3.45 

QUAD-GP 


34 


149 


13 


8.72 


Table  5A  Pi  reel  Primal  Results 
_2 

10  Relative  Error 
AVG.  CPU  Time  (Secs) 


Table  5B  Direct  Primal  Results 
10’ ^  Relative  Error 

AVG.  CPU  TIME  (Secs) 


TW 


BIAS 


MAYNE 


T 


TTMF 


T 


TIME 


RALP 


0.6475 

0.4953 

0.2956 

1.3514 

0.3895 

0.6671 

1.1177 

0.6414 

1.0209 

0.9925 

0.5036 

0.9849 

3.4559 

3.4367 

1.9572 


5.1514 

13.316 

5.576 

5.2618 


6.3759 


20 

20 

20 

1 

20 

20 

2 

20 

10 

20 

19 

20 
2 

2 

2 

2 

2 

2 


1  £"!  1 

liiju 

0.209 

33.74 

4.093 

3.978 

13.51 

2.7 

5.501 

3.717 

0.7427 

5.937 

24.515 


9.416 

37.715 


27.452 

14.147 

29.80 


35.65 


20 

20 

20 


2 

2 

20 

17 

20 

19 

20 

19 

20 
2 

14 

13 

11 

17 


20 


3.461 

2.509 

1.5565 


5.161 

4.576 

5.717 

8.647 

5.769 

3.836 

9.293 

21.35 


11.38 

27.88 

27.35 

19.726 

23.79 

63.98 


56.54 


10 

20 

20 

20 

1 

20 

20 

20 

17 

19 

10 


13 

4 

1 


TTWF 


0.130 


0.768 

1.191 

0.6185 

1.496 

7.08 

2.289 

3.22 

3.986 

2.569 

10.036 


11.66 


21.20 


4.325 


1 

1 


26.1704 

54.8196 


2 

2 

2 


19.625 

36.14 

41.63 


Table  5C  Direct  Primal  Results 
-4 

10  Relative  Error 
AV6.  CPU  Time  (Secs) 


Table  6A; 


Conve ■ i f :  I  Primal  Results 

.  9 

10  Relative  Error 


AVG  CPU  TIME  (secs) 


Prob 

n  opt 

T  BIAS 

I  BIAS-SV 

1 

No. 

§ 

TIME 

m 

\WM 

T 

1 

20 

0.4842 

20 

0.6925 

4 

0.6545 

20 

2 

20 

0.1753 

20 

0.5005 

1 

0.3050 

20 

3 

18 

0.0873 

18 

0.0818 

18 

0.0708 

18 

4 

20 

0.2656 

2 

20.686 

4 

11.779 

20 

5 

20 

0.0972 

20 

1 .0305 

20 

1.5750 

20 

6 

20 

0.2963 

20 

7 

20 

0.2081 

2 

5.973 

20 

8 

20 

0.2005 

20 

0.7731 

20 

9 

20 

0.2774 

20 

1 .253 

10 

2.653 

7 

10 

20 

0.1292 

20 

2.853 

2 

9.511 

20 

11 

20 

0.2643 

20 

1  .634 

10 

3.512 

20 

12 

20 

0.4001 

20 

2.284 

10 

5.881 

20 

13 

20 

0.1820 

20 

0.6625 

20 

14 

14 

0.0963 

14 

0.1637 

14 

0.5308 

18 

16 

18 

0.1944 

18 

1 .127 

2 

9.639 

18 

17 

.20 

0.8506 

20 

2.099 

1 

31.32 

20 

18 

20 

0  4696 

19 

20 

0.5193 

20 

5.605 

2 

63.39 

20 

20 

20 

0.3175 

20 

2.360 

2 

18.324 

19 

21 

10 

7.506 

2 

TI0.66 

20 

22 

20 

1.3209 

10 

6.635 

20 

23 

20 

1.5894 

24 

10 

7.750 

2 

40.38 

20 

25 

20 

3.602 

2 

45.87 

20 

26 

10 

11.334 

20 

27 

1 

1.0102 

1 

28 

20 

2.516 

2 

24.04 

20 

29 

20 

1.4573 

8 

4.571 

2 

20 

30 

1 

1  2.6070 

31 

2 

1.6350 

iSiipPM 

32 

15 

3.337 

2 

33 

34 

2 

0.8279 

2 

6.290 

2 

35 

20 

0.7272 

2 

5.022 

2 

36 

2 

0.7605 

2 

17 

1 

q 

) 

1 

33.05 

1 

1 

4.944 

1 

12.800 

GGP 

TIME 


0.2998 

0.2714 

0.2243 

0.2828 

0.3747 

0.4283 

0.3126 

0.3160 

0.3166 

0.7512 

0.5520 

0.6240 

0.6530 

0.6005  I 

0.8927  | 

0.7925  ! 


1.651 

2.932 

2.293 

2.206 


1.1495 

3.450 

1.837 

0.456 

1.979 

3.245 

0.440 

. 

i  1.6345 

I 

i  2.177 
!  7.570 
j  4.225 
I  1.543 


1  8.751 


GPKTC 
#  TIME 


20 

0.3320 

18 

0.2510 

20 

0.4940 

20 

0.2845 

0.4900 

20 

0.3935 

18 

0.6185 

16 

20 

0.4590 

9 

0.8852 

18 

0.7353 

20 

1.077 

9 

3.983 

6.707 

1 

3.075 

1 

2.210 

8 

35.28 

15 

1.1870 

1 

3.476 

19 

2.229 

1 

13.559 

RALP 

1  TTMF 


20 

0.1075 

18 

0.3650 

20 

0.8775 

20 

0.3220 

20 

4.999 

19 

0.6582 

20 

0.9635 

20 

1.244 

20 

0.9100 

20 

1.402 

20 

1.187 

8 

0.9823 

18 

5.588 

20 

2.750 

1 

5.259 

15 

9.463 

20 

5.620 

13 

8.643 

9 

8.216 

20 

8.213 

7 

1  7.165 

1 

6.302 

SI 

12.14 

u 

15.74 

i 

82.43 

i 

31.45 

Table  6B: 


Convexi fied  Primal  Results 
_  3 

10  Relative  Error 


AVG  CPU  TIME  (secs) 


OPT 

BIAS 

1  B IAS- S V 

[  GGP 

I  GPKTC 

1  RALP 

# 

TIME 

MM 

TIME 

a 

TIME 

MM 

TIME 

TIME 

■1 

TIME 

20 

0.4948 

20 

0.959 

4 

0.9717 

20 

0.2878 

0.112 

20 

0.2296 

20 

0.6145 

1 

1.451 

20 

0.3293 

20 

0.332 

18 

0.1491 

20 

0.0925 

20 

0.0815 

20 

0.2707 

20 

0.2565 

15 

0.3965 

20 

0.2993 

20 

21.52 

3 

12.625 

20 

0.3246 

20 

0.9115 

20 

19 

0.1809 

0.3503 

20 

1.2365 

20 

2.248 

20 

20 

0.4702 

0.4659 

20 

0.3015 

20 

17 

0.490 

5.109 

20 

0.3174 

20 

1.4025 

7 

3.592 

7 

0.4119 

20 

10.343 

20 

0.1872 

20 

3.291 

2 

12.047 

20 

0.9647 

20 

0.4385 

20 

1.471 

20 

0.3244 

20 

1.8085 

3 

3.920 

20 

0.647 

18 

0.6265 

19 

1.051 

20 

0.5014 

20 

2.474 

10 

6.582 

20 

0.752 

18 

1  .11 

15 

1.615 

20 

0.3613 

20 

1 .0985 

20 

0.8475 

20 

0.. 

20 

1.649 

20 

0.1446 

19 

0.2166 

19 

0.6365 

19 

0.8097 

14 

0.8.  .9 

10 

1.328 

20 

20 

0.4082 

0.9798 

20 

20 

1.5855 

2.914 

2 

10.463 

20 

20 

1.3205 

0.995 

20 

0.856 

m 

7.790 

3.092 

4 

0.7012 

2 

64.15 

12 

0.8774 

20 

0.5275 

20 

2.917 

2 

20.36 

19 

3.782 

18 

5.757 

20 

20 

1.6684 

1.9682 

8 

7.633 

20 

2.681 

1 

8.157 

10 

20 

10 

8.755 

4.359 

12.102 

1 

9 

44.14 

51.24 

?n 

1.4345 

4.435 

2.408 

0.577 

2.774 

4.614 

10 

1 

6.766 

3.097 

20 

20 

1 

20 

20 

20 

8.597 

3 

8.311 

6.305 

1 

1.3333 

1 

0.4882 

1 

2 

8 

25.475 

8.171 

10 

7 

13.052 

16.190 

20 

1 

2 

2.233 

2.843 

1.5293 

■S9 

8 

37.03 

20 

4.367 

2 

89.77 

20 

2.234 

20 

1.4365 

----- 

20 

13.598 

1 

0.8861 

2 

7.382 

2 

2.905 

mmm$m 

11.371 

18 

1.1286 

2 

8.095 

2 

10.050 

6 

i 

2 

1.0415 

2 

7.276 

83.12 

SwisiBSBjJ 

jl-.jl.559 

1 

1 

196.366 

79.72 

1 

1 

1 

40.46 

6.037 

16.006 

8.751 

L_ 

Table  6C:  Convexlfied  Primal  Results 

-4 

10  Relative  Error 
AVG  CPU  TIME  (secs) 


.1  OPT 

3IAS 

B IAS- S V 

I  GGP 

i  GPKTC 

I  RALP 

No. 

J - 1— 

1  TIME 

# 

TIME 

# 

TIME 

U 

1  time 

TIME 

m 

TIME 

1 

■ 

2 

0.3058 

20 

n.769 

1 

1 .572 

m 

0  3763 

3 

0.1617 

20 

20 

0.083 

i 

0.3115 

20 

0.2575 

2 

0.390 

4 

5 

0.3875 

1 

12.316 

20 

0.4179 

17 

1.067 

6 

8 

0.3509 

9  n 

9 

7 

0.3544 

20 

1.544 

_ 

Bli 

15 

10.910 

UB 

16 

0.2643 

20 

3.34 

2 

12.520 

1 .148 

20 

20 

1.574 

li 

9 

0.3726 

20 

2.001 

0.7905 

1 

0.641 

2 

1 .192 

12 

7 

0.5498 

20 

2.876 

1 

4.966 

0.897 

1 

1.151 

13 

19 

0.4472 

20 

1.3795 

Hip 

0.994 

19 

0.9346 

16 

1.9319 

14 

9 

0.1968 

1.1887 

9 

1.1792 

3 

1.128 

16 

0.6257 

20 

1.8845 

2 

10.629 

20 

1.68 

20 

10 

7.401 

17 

17 

1.229 

20 

3.919 

20 

1.178 

12 

3.23C 

20  • 

5 

0.7546 

20 

3  054 

9 

6  604 

25 

20 

4.486 

2 

51.46 

6 

6.027 

1 

3.169 

— 

27 

1 

1.7049 

1 

0.705 

1 

6.305 

28 

8 

3.026 

_ _ 

1 

15.439 

29 

19 

2 

15.047 

20 

7.031 

1 

15.183 

1 

18.364 

"I 

1 

BH 

j  2 

20 

5.465 

2 

90.93 

20 

3.516 

20 

1 .7865 

35 

1 

1.2891 

1 

9.198 

- - 

2 

13.205 

6 

11.393 

36 

1 

1.2695 

2 

11.785 

1 

83.19 

38 

1 

919  9 

39 

1 

45.4 

1 

20.99 

1 

85.75 

40 

1 

6  153 

41 

1 

16.346 

Table  8  Dual  Results 


CPU  Time  (Seconds) 


Relative  Error  10 


MCS 


#  I  TIME  I  # 


0.1666 

0.5370 

0.7160 


10.485 

0.2263 

0.3100 

2.554 


1.2655 

5.420 


167.53 

10.394 

11.621 

13.106 

1.2995 

1.349 


0.9825 

0.4750 

28.89 

0.3250 


0.8530 

0.1533 

0.1979 

0.1923 

0.8166 

0.4284 

0.08015 

0.1647 

0.5392 

1.4333 

15.43 


0.6464 

0.7738 

1.9732 

3.035 

0.1225 

26.597 

19.067 


Relative  Error  10"^ 

j _ MCS 

1  OUADGP 

# 

TIME 

in 

TIME 

20 

0.542 

18 

0.2081 

4 

0.17883 

20 

0.768 

5 

0.2689 

20 

|  1.995 

5 

0.3070 

1  . 

j 

5 

0.9524 

20 

0.1724 

20 

!  0.7755 

5 

0.2377 

20 

1.7185 

5 

0.5823 

4 

1.6942 

10 

15.931 

3 

16.387 

19 

0.3658 

3 

0.3026 

19 

0.3755 

2 

0.6175 

20 

5.0 

5 

1.9298 

20 

1 .4365 

20 

7.476 

5 

1.2255 

4 

10.049 

1 

177.43 

20 

15.421 

5 

3.287 

20 

12.784 

2 

4.486 

3 

78.99 

5 

3.79 

10 

3.913 

10 

7.638 

10 

1.3435 

10 

0.607 

2 

2.135 

8 

40.63 

10 

0.4805 

5 

0.1314 

Relative  Error  10"^ 


MCS  _ f  QUAD6P 


□I 

1  TIME 

mm 

TIME 

H 

m 

1 

m 

1  4 

0.1896 

20 

■jag 

1  5 

0.2904 

20 

HI 

| 

1  5 

1.0253 

!  5 

1 .0253 

20 

0.1731 

1 

20 

j  5 

0.2463 

20 

2.40 

5 

0.6012 

4 

1 .8505 

10 

16.471 

2 

Ml*  21 

20 

0.3915 

3 

mss 

20 

0.4605 

2 

0.9315 

20 

5.331 

5 

2.086 

20 

1.8135 

20 

8.856 

5 

1.6259 

• 

mm 

1 

178.43 

20 

16.622 

20 

12.901 

1 

5.541 

3 

117.99 

10 

7.786 

10 

10.359 

10 

1.767 

10 

0.673 

2 

2.452 

8 

51.81 

10 

0.543 

3 

4 

35.15 

5 

3 

4 


0.1314 
31.977 
31 .18 


Table  9:  OPT  Primal  Form  Comparisons 
(CPU  Times  Divided  by  Convex  Primal  Times) 
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Table  11A: 


Summary  Cross  Comparison:  Relative  Error  10* 
CPU  Times  in  Seconds 


Table  11B: 


Summary  Ci  u-Comparison  (Relative  Error  10  ) 

CPU  Time  in  Seconds 


0.6475 

0.4953 

0.2956 

1.3514 

0.3895 


0.6671 

1.1177 

0.6414 

1  .0209 

0.9925 

0.5036 

0.9848 

3.455 

3.436 


1.9572 


5.151 

13.316 

5.576 

5.262 


6.379 


26.17 

54.82 


0.4948 

0.2296 

0.1491 

0.2993 

0.1809 

0.3503 


0.3174 

0.1872 

0.3244 

0.5014 

0.3613 

0.1446 

0.4082 

0.9798 

0.7012 

0.8774 


1 .6684 
1 .9682 


0.2878 

0.3293 

u.2707 

0.3246 

0.4702 

0.4659 


0.4119 

0.9647 

0.647 

0.752 

0.8425 

0.8097 

1  .3205 

0.995 


1  .333 

2.234 

2.843 

1.5293 


3.782 

2.681 

1  .4345 

4.435 

2.408 

0.577 

2.775 

4.614 


0.8861 
1 .1286 
1 .0415 


40.47 

6.038 

16.01 


2.235 

2.905 

10.051 

7.276 


8.751 


0.3590 

0.2167 

0.0690 

0.4925 

0.6149 

0.4038 


2.021 
0.2903 
1.3407 
2.393 
0.7693 
1 .4042 
1  .0381 
12.992 
0.3399 


17.44 

9.638 

30.75 

10.158 

13.403 


1  .242 

27.98 

3.672 

0.6723 


2.777 
5.016 
1  .731 


DUAL 

(MCS) 


0.542 

0.2081 

0.7680 

1.995 


0.1724 
0.7755 
1  .7185 


15.93 

0.3658 


0.3755 

5.00 


177.4 

15.42 

12.78 

78.99 

3.914 

7.638 


1  .3435 
0.607 
40.63 
0.4805 


T-DUAL 

(QUADGP) 


1.7883 


0.2689 

0.3070 

0.9524 


0.2377 
0.5823 
1 .6942 
16.387 
0.3026 


0.6175 
1  .9298 


3.288 

4.486 

3.790 


2.135 


0.1314 


31  .97 
31  .18 


Table  11C: 


PRIMAL 

(OPT) 


0.6147 

0.3323 

1.3717 


0.6862 
1.5322 
0.7926 
1.5076 
1 .5786 


1.8454 

4.110 


5.242 

17.77 

5.959 


26.59 

55.74 


Summary  Cr c  - , -Comparison:  (Relative  Error  10*  ) 
CPU  Time  in  Seconds 


C-PRIMAL 
OPT 


0.3058 

0.1617 

0.3875 

0.3509 


0.3544 
0.2643 
0.3726 
0.5498 
0.4472 
0.1968 
0.6257 
1  .227 


0- PRIMAL 
GGP) 


0.3763 

0.3115 

0.4179 


0.5841 


0.4330 
1 .1480 
0.7905 
0.8970 
0.9940 
1  .189 
1.680 
1  .178 


T-PRIMAL 

DAP 


0.4729 

0.3073 

0.0706 

0.5065 


T-DUAL 

P) 


0.5460 

0.2275 


0.1896 


0.7386 


0.9290 
0.6237 
1  .7970 
3.2332 
1  .1689 


2.7303 

16.78 


0.3730 

4.070 


0.1731 
1  .198 
2.400 


0.2904 


16.47 

0.3915 


1 .0253 


0.2463 
0.6012 
1 .8505 
15.28 
0.3292 


0.4605 

5.331 


0.9315 

2.086 


1  .7049 


2.978 

3.102 


6.028 


0.705 

3.026 

7.032 


20.28 


30.81 

10.24 


1  .814 
8.857 


178.4 

16.62 

12.90 

118.00 

7.786 

10.36 


1  .767 
0.6730 
51  .81 
0.5430 


1  .626 


5.541 


2.453 


35.06 


35.15 


Table  12.  Sample  Standard  Deviations  Data  (Relative  Error  of  10" 


Table  12.  (continued) 


Code  with 
Best  Avg. 
Time 

DAP 

MCS 


DAP 

QUADGP 
OPT- CP 
DAP 

OPT-CP 

QUADGP 

QUADGP 

OPT-CP 

OPT-CP 

OPT-CP 

QUADGP 

OPT-CP 

DAP 

GGP 

DAP 

QUADGP 

OPT-CP 

GGP 


Table  13.  Sample  Student  Test  Results 
(Relative  Error  10'^) 


Next  Best 
Code 

Student's 
t  Value 

Degree  of 
Freedom 

Significance 
Level  of 
Difference  (%) 

GGP 

7.203 

21.45 

99+ 

DAP 

0.053 

38.01 

10- 

QUADGP 

0.172 

3.65 

15- 

OPT-CP 

1.811 

35.44 

90+ 

OPT-CP 

3.208 

19.54 

99+ 

OPT-CP 

21.23 

24.68 

99+ 

QUADGP 

6.26 

11.23 

99+ 

OPT-CP 

4.70 

39.70 

99+ 

GGP 

12.31 

29.82 

99+ 

MCS 

34.6 

22.90 

99+ 

OPT-CP 

28.02 

19.86 

99+ 

DAP 

4.795 

25.78 

99+ 

OPT-P 

12.02 

24.65 

99+ 

GGP 

11.28 

29.96 

99+ 

OPT-CP 

5.08 

19.54 

99+ 

OPT-P 

6.18 

21.11 

99+ 

OPT-CP 

1.205 

28.84 

75+ 

MCS 

4.525 

36.35 

99+ 

OPT-CP 

2.730 

35.92 

99+ 

OPT-CP 

0.903 

5.77 

60- 

OPT-P 

11.62 

9.50 

99+ 

OPT-CP 

2.34 

8.49 

95+ 

OPT-P 

N.A. 

N.A. 

DAP 

1.662 

7.380 

85- 

QUADGP 

5.144 

4.021 

99+ 

Table  13.  (continued) 


Problem 

Number 

Code  with 
Best  Avg. 
Time 

Next  Best 
Code 

Student's 
t  Value 

Degree  of 
Freedom 

22 

OPT-CP 

GGP 

11.06 

38.56 

23 

OPT-CP 

QUADGP 

N.A. 

N.A. 

24 

GGP 

QUADGP 

3.518 

6.093 

25  | 

DAP 

GGP 

2.854 

10.33 

26 

GGP 

QUADGP 

2.083 

4.069 

MCS 

30.14 

6.208 

27 

GGP 

OPT-CP 

N.A. 

N.A. 

28 

MCS 

GGP 

5.725 

25.52 

29 

OPT-CP 

GGP 

13.62 

21.23 

30 

DAP 

GGP 

N.A. 

N.A. 

31 

QUADGP 

MCS 

1.214 

11.49 

OPT-CP 

N.A. 

N.A. 

32 

DAP 

MCS 

3.288 

15.21 

33 

QUADGP 

MCS 

18.50 

8.78 

34 

QUADGP 

MCS 

3.170 

9.004 

35 

DAP 

OPT-CP 

5.344 

10.55 

Table  14.  CODE  Ranking 


Relative 

Error 

10'2 

_ 

Ranking 

1st 

2nd 

OPT-CP 

13 

14 

DAP 

16 

1 

GGP 

6 

9 

QUADGP 

10 

5 

MCS 

3 

6 

OPT-P 


0 


Table  15A.  Correlation  Coefficient  of  log(CPU  time)  VS. 


Table  158.  Correlation  Coefficients  of  (CPU  time)  VS. 


Amend  ix 


OPT 

EPSIS 

10~3 

EPSBD 

10‘5 

EPS 

IQ'6 

CRIT 

10“4 

BIAS 

EPSLS 

10~4 

EPSI 

10~5 

MAYNE 

TT 

10"1 

ALL 

10-6 

FF 

10-6 

FC 

10_1 

RALP 

QC(1) 

1000 

QC  (2) 

10"2 

QC  (3) 

10-5 

QC  (4 ) 

10"5 

QC  (5) 

.8 

GGP 

EPSCON 

lO-5 

EPSCGP 

10"5 

EPSLP 

10_U 

EPSPN 

10'11 

MCS 

TTOL 

10-5 

YTOL 

10"7 

DUTOL 

10"6 

OFTOL 

5  x  10 

CTOL 


(Appendix  A  continued) 


GPKTC 


QUADGP 


DAP 


TAl"  J L 

5  x  10 

OPTOL 

10-5 

EPSCON 

10-5 

EPSDO 

10"5 

BETA 

CN 

1 

O 

H 

BS 

l 

IREF 

l 

No  other  options 

EPSCOV 

ID'6 

EPSTOL 

10"3 

VELTOL 

2  x  10“6 

EPS 

ID"3 

TOLCON 

1 

O 

EPSEQ 

o 

1 

'-J 

EPSVAR 

10-3 

• 

EPS 

o 

1 

'Vl 

EPS1 

ID'6 

EPS2 

io'4 

-5 

EPS3 

10 

EPS4 

10"4 

R 
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Part  II.  Generalized  GP  Study 
1.  Introduction 

Geometric  Programming  (GP)  is  a  body  of  theoretical  and 
algorithmic  results  concerned  with  constrained  optimization 
problems  involving  a  class  of  nonlinear  algebraic  functions. 

The  pioneering  work  in  this  field  was  performed  by  Duffin, 

Peterson,  and  Zener  [l]  who  developed  a  duality  theory  for 
nonlinear  programs,  now  called  prototype  GP's,  that  consist 
of  an  objective  function  and  upper  bounded  inequality  constraints 
involving  posynomial  functions,  that  is,  functions  of  the  form, 

Tk  N 

gk(x)  =  I  Ct  IT  x^nt 

t=S.  r=l 
k 

where  all  C  >0  and  the  a  are  arbitrary  real  numbers.  Soon 
t  nt 

after  this  development,  extensions  of  the  methodology  were 
reported  by  Passy  and  Wilde  [2)  which  allowed  the  sign  restrictions 
on  the  coefficients  C^.  to  be  dropped  and  could  accommodate  both 
upper  and  lower  bounded  inequality  constraints’  Since  this  extension 
was  reported,  a  considerable  number  of  applications  involving 
such  generalized  geometric  programs  (GGP)  have  been  published 
(see  the  bibliography  reported  by  Rijckaert  [ 3 ] )  and  numerous 
algorithms  for  solving  both  GP's  and  GGP's  have  been  proposed 
in  the  literature  (see  [^]  and  [5]  for  reviews).  However, 
relatively  little  attention  has  been  given  to  an  appraisal  of 
the  computational  significance  of  the  various  theoretical  and 
algorithmic  GGP  developments.  This  paper  is  the  third  in  a 
series  of  studies  on  the  computational  utility  of  GP  formulations 


33 


and  developments.  The  overall  goals  of  this  research  has 
been  to  determine: 

i)  whether  the  constructions  resulting  from  GP  developments 
offer  any  computational  advantages  over  conventional  NLP 
methodology 

ii)  which  of  the  various  equivalent  GP  problem  formulations 
are  preferrable  and  under  what  conditions 

iii)  which  GP  algorithm/formulation  combination  is  most 
likely  to  be  successful  for  a  given  problem 

iv)  whether  a  criteria  can  be  defined  by  means  of  which  GP 
problem  difficulty  can  be  gauged. 

While  in  previous  two  papers  [6,73  ,  these  questions  were 
addressed  in  the  context  of  prototype  GP  problems,  the  present 
work  will  specifically  be  addressed  to  generalized  GP  problems. 

By  way  of  review,  we  briefly  summarize  the  alternate  GGP  formulations 
and  key  computationally  significant  features  in  the  next  section. 

2.  Equivalent  GGP  Problem  Structures 
2.1  The  Primal  Problem 

The  generalized  GP  primal  problem  (P)  in  the  form  initially 
presented  by  Passy  and  Wilde  [2]  is, 

Minimize:  g  (x) 

Jo 

Subject  to:  (gm(x))  m  £  1  m  =  1 , . .  ,M 


x  >  0 


where  the  signomial  functions  g^(x)  are  defined  as 

T  u 

m  N  a 

9  (*)  ■  l  a  C  n  x  n 

m  t-S  1  *n-l  n 
m 
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with  specified  positive  coefficients  and  arbitrary  exponents 

I 

phe  coefficients  o  and  take  on  the  specified  values  +  1 
and  are  known  as  signum  functions.  The  term  indices  t  are  defined 
consecutively  as, 


S  =  1 
o 

S  =  T 
m+1  m 

TM  =  T 


+  1 


As  in  the  posynomia!  case,  the  difference  T-N-l  is  referred  to  as  the  degree 
of  freedom  of  the  problem. 


The  above  problem  is  in  general  a  non-convex  nonlinear  program 
which  may  possess  multiple  local  minima.  A  structurally  more  revealing 
but  not  necessarily  computationally  more  advantageous  form  of  the 
primal  can  be  obtained  by  rewriting  each  signomial  function  as  the 
difference  of  two  posynomials,  i.e. 


where , 


9m(x)  "  Pm(x)  -  Qm(x) 


PU) 

m 


•l  N 

tePm  C  II  xant 
t  i  n 


’  tkc‘ 


N 

n 

n=  1 


a 

x  nt 


and  Pm  is  ^e  subset  of  term  indices  of  signomial  m  whose 

signum  functions  are  positive,  and  Um  is  the  subset  of 
term  indices  of  signomial  m  whose  signum  functions  are 
negat i ve . 

As  shown  by  Avriel  and  Williams  [9],  the  generalized  GP  primal 
can  then  be  written  in  the  complementary  or  quotient  form,  (QP) 
Minimize:  x 

o 

Subject  to:  fm(x)  <1  m  -  1...  ,  M+1 
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fchere  each  function  fm(x)  is  a  quotient  of  posynomials, 


Pjx) 

f  (x) - 5 - 

Qm(x)  +  1 


m  =  1 , . .  ,M 


and  fH+j (x)  is  given  by 

Po(x) 

fM+l^  _  xQ  +  Qq(x) 

Note  that  the  variable  xq  is  simply  a  device  used  to  transform 
the  signomial  objective  function  to  a  constraint.  Furthermore,  the 
positivity  of  xq  is  guaranteed  by  if  necessary,  including  a  positive 
constant  of  suitable  magnitude  as  one  of  the  terms  of  Pq(x) . 

Alternatively,  Duffin  and  Peterson  [9]  have  shown  that  since  each 
signomial  can  be  written  as  the  difference  of  two  posynomial  functions, 
each  signomial  constraint  can  be  replaced  by  two  posynomial  constraints 
one  of  which  is  a  lower  bounded  constraint.  Specifically,  by  introducing 
an  artificial  variable  y^,  each  constraint 

Pm(x)  '  Qm(x)  i  ’ 


can  be  replaced  tv, 

pm(x)  £ymi,  +  Qj*) 

or’  -1  -1 

ym  PmW  £  1  and  (1  +  Qm(x))ypn  >  1 
Therefore,  at  the  expense  of  increasing  the  number  of  variables 
and  constraints,  the  signomial  program  can  be  converted  to  a  reversed 
GP,  a  problem  in  which  all  functions  are  posynomials  but  some  are 
involved  in  upper  bounded  or  normal  constraints  while  others  are  involved 
in  lower  bounded  or  reversed  constraints. 


Thus,  the  reversed  primal  GP  (RP)  is  defined  as  follows. 
Minimize:  hQ{x) 

Subject  to:  { x )  <1  k=l,..,K 

hk(x)  >  1  k=K+l,..,L 

x  <  0 

where  all  hk(x),  k=0,l,..,L,  are  posynomials. 

Finally,  Duffin  and  Peterson  [9]  have  suggested  continued  application 
of  a  similar  construction  to  reduce  all  multi-term  constraints  to 
two  term  constraints,  alluding  to  possible  computational  advantages. 
Thus,  if  ut  denotes  a  posynomial  term,  then 
u-j  +  u2  +  u3  £  1 
Could  be  replaced  by, 

(u1  +  u2)  y^1  <  1  and  y1  +  u3  £  1 
Moreover,  the  reversed  constraint, 

U-j  +  u?  +  u3  >  1 

could  be  replaced  by, 

(u1  +  u2)y^  >_  1  and  y-j  +  u3  >_  1  . 

Presumably  each  of  the  four  primal  formulations  could  be  solved 
directly  by  the  application  of  suitably  specialized  NLP  techniques 
and,  presumably,  one  ought  to  be  preferred  over  the  others. 

2.2  The  Exponential  Primal  Problem 

As  in  the  prototype  case,  each  signomial  function  can  be  recast 
to  a  sum  of  exponentials  via  the  transformation  xn  =  exp(zn). 

Thus,  the  signomial, 
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Tm  N 

gm(x)  =  y  a^C.  IIx*nt 

m  L  t  t _ n 

.  c  n=  i 

t»S 

can  be  replaced  by, 

9m(2>  *  I  °tCt  exp  (j>  zn>  • 
t  n 

Whereas  the  original  variables  xp  are  constrained  to  be  positive, 
the  zn  are  unrestricted  in  sign.  In  the  posynomial  case,  these 
exponential  functions  are  convex  functions  and  use  of  this  form  of 
the  primal  in  computation  proved  to  be  much  preferrable  to  direct 
primal  solution  [7].  In  the  signomial  case,  the  transformed  functions 
are  in  general  nonconvex,  hence,  some  of  the  computational  advantages 
may  well  be  diminished.  However,  application  of  this  transformation 
to  the  reversed  primal,  results  in  a  problem  in  which  all  functions, 

hk(z>  =  Zct  “P  <Kt2n> 
t  n 

are  convex  but  the  feasible  region  is  the  intersection  of  a  convex 
set,  generated  by  the  inequalities 

hk(z)<  1  k=l  ,..,K 

and  a  reverse  convex  set,  generated  by  the  inequalities 
hk(z)  >_  1  k=K+l , . .  ,L 

A  reverse  convex  set  is  simply  the  complement  of  a  convex  set. 

The  exponential  form  of  the  reverse  primal  thus  clearly  reveals  the 
underlying  structure  of  GGP  problems  and  clarifies  the  reason  for 
the  possible  occurrence  of  multiple  local  minima. 

2.3  The  Transformed  Primal  Problem 

The  exponential  form  of  the  reversed  primal,  can  with  the  further 
change  of  variable, 

w  =  AT  z  +  Inc 

'U  'X/ 
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where  A  is  the  matrix  of  primal  variable  exponents  and  Inc  the 

% 

vector  of  logs  of  the  term  coefficients  ,be  rewritten  to  the  transformed 
primal  form, 

Minimize:  hQ(w) 

Subject  to:  h.(w)  <  1  k=l,..,K 

''O 

(w )  >_  1  k=K+l , . .  ,L 

L(w-lnc)  =  0 

%  a* 


where. 


hk(w) 


and,  as  in  the  prototype  case,  the  rows  of  the  matrix  L  are  any  set 
of  linearly  independent  vectors  spanning  the  null  space  of  A  [10]. 

This  form  of  the  primal  offers  very  attractive  structural  features 
for  computation,  but  it  is  not  clear  whether  the  considerable  increases 
in  variable  and  constraint  dimensionality  which  these  transformations 
impose  are  adequately  compensated  by  increased  computational  efficiency. 
2.4  The  Dual  Problem 

As  shown  in  [3],  the  GGP  problem  has  associated  with  it  a  dual 
problem,  (D) 


,  T  C.  o.S*  M  1.1 

Extremize:  v(6)  =  o'  (IT  [-■)  1  1  n  X^mV  o 

0  t=l  Jt  m=l  m 


Subject  to: 


o 

l  vt 

t=l 


1 


o 


o 


J,°t  *ntSt  -  0 

6  >  0 

X  >  0 

%  'X, 


where 


and. 


1  m 

x  =  0  y  0.6. 

m  m  L  t  t 

t  =  Sm 

m 

1  min  gQ(x) 
°o  ~|min  gQ(x) 


Although  relationships  between  primal  and  dual  variables  at 
corresponding  stationary  points  can  again  be  given,  as  in  the  prototype 
case,  the  bounding  relationship  between  the  primal  and  objective  functions 
no  longer  holds.  Hence,  maximization  of  the  dual  must  be  replaced 
by  a  search  for  dual  stationary  points  [3].  These  properties  of  the 
dual  are  made  quite  apparent  if  the  primal  is  formulated  in  the  reversed 
GP  form.  In  that  form,  it  becomes  clear  that  In  v(6)  is  concave  with 
respect  to  the  dual  variables  associated  with  upper  bounded  constraints 
and  convex  in  the  dual  variables  associated  with  lower  bounded  constraints 
[9].  Solution  of  the  dual  thus  amounts  to  locating  equilibrium  or 
saddle  points.  This  feature  disallows  direct  maximization  and  thus  GGP 
dual  solution  requires  numerical  solution  of  the  Lagrangian  conditions 
applied  to  the  dual.  As  in  the  prototype  case,  however,  this  approach 
must  be  used  with  great  care  because  of  difficulties  presented  by  vanishing 
dual  variables  [5]. 

2.5  The  Transformed  Dual  Problem 

A  reduction  of  the  generalized  dual  to  a  transformed  dual  similar 
to  that  developed  for  prototype  GP's  [1],  can  also  be  carried  out  and 
is  reported  In  [9].  This  transformation  does  not,  however,  ameliorate 
the  difficulties  posed  by  the  search  for  saddle  or  equilibrium  points. 
Numerical  solution  of  the  Lagrangian  condition  appears  to  be  the  only 
route  for  solving  GGP's  via  the  transformed  dual. 
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3.  Solution  Approaches 

The  solution  methods  proposed  for  generalized  GP's  have  generally 
been  of  two  types:  sequential  methods  employing  a  series  of  approximating 
problems  and  direct  approaches  to  one  of  the  equil valent  GGP  forms. 
Available  fragmentary  evidence  indicates  that  the  sequential  methods 
are  superior  to  direct  approaches. 

3.1  Sequential  Minimization 

The  QP  and  RP  forms  of  the  primal  suggest  that  if  the  denominators 
and  reversed  constraints,  respectively,  could  be  replaced  by  approximating 
single  term  posynomials,  then  the  resulting  approximating  problems 
would  reduce  to  prototype  GP's.  Such  approximations  can  readily  be 
obtained  via  the  condensation  device  proposed  by  Avriel  and  Williams 
[8]  and  Duffin  Ill]. 

T 

Given  a  posynomial  ,  P(x)  =  £ut(x),  and  a  set  of  non-negative, 

t=  1 

normalized  parameters  at,  t=l,..,T,  then  from  the  inequality  between 
the  arithmetic  and  geometric  means,  it  follows  that 

P(x)  =  £u  (x)  >  n  AA  _  P(x,o)  (1) 

t  t  v  " 

Thus,  a  multi-term  posynomial  P{x)  is  approximated  by  a  single  term 

a. 

posynomial  P(x,a).  Using  this  construction,  Avriel  and  Williams  [8]  have 
proposed  replacing  the  constraints  of  a  QP, 


Pm  (x ) 

fmCx)  = 


<  1 


with  the  approximation, 


fm(x)  =  Pm(x)  (Q(x  a)) 


-1 


<  1 
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Similarly,  Duffln  proposed  replacing  the  reversed  constraint 
hfc(x)  >  1 

with  the  posynomial  approximation, 

(hk(x1a))  <  1 

Note  that  since  inequality  (1)  is  an  equality  if  and  only  if, 
at  =  ut^ut’  tJie  Parameters  at  the  approximating  functions  are 
in  both  the  QP  and  RP  cases  updated  by  setting, 
k 

k — 1  ct 

where  x  is  the  solution  of  the  k-1  —  approximating  problem.  Thus 
a  series  of  approximating  problems  is  generated  and  solved  until,  the 
di fference 


,  k  k-U 
(°t  '  “t  } 

becomes  sufficiently  small  for  all  t.  It  can  be  shown  [8]  that, 

( i )  any  feasible  point  of  an  approximating  problem  will 

also  be  a  feasible  point  of  the  GGP 

(ii)  the  sequence  of  approximating  problem  solutions  will 

converge  to  a  local  minimum  of  the  GGP  under  mild  assumptions 

It  can  further  be  shown  [12]  that  condensation  of  P(x)  is  equivalent  to 

a  Taylor  series  linearization  of  lnP(x)  with  respect  to  the  variables 

lnxn>  Thus  condensation  may  be  viewed  as  a  special  type  of  partial 

linearization.  The  advantage  of  condensation  as  opposed  to  direct 

Taylor  series  linearization  is  that  it  leads  to  a  closer  approximation 

of  the  original  posynomial  [12]. 

Note  that  since, 
u*  a* 


nAA  =  n  c  rix"1  at  .  n  tc,  at  nx  Jantat 

*v  .  <4>  " 
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the  condensation  calculation  will  result  in  changes  In  the  exponent 
matrix  of  the  variables.  To  avoid  recomputation  of  the  exponent 
matrix,  Duffin  and  Peterson  [13]  have  proposed  an  alternate  condensation 
construction  which  employs  the  harmonic  mean.  Using  this  construction 
the  reversed  inequality, 

K  £  1 

is  replaced  by  the  approximation, 

I«t(ut)_1  -  1 

where  the  a^'s  are  updated  as  before.  It  can  be  shown  [13]  that  the 
harmonic  mean  condensation  of  a  reversed  constraint  can  always  be 
bounded  by  the  geometric  mean  condensation, 

u.  a+  ,  -1  -1 

Thus,  the  savings  in  exponent  matrix  recomputations  are  obtained 
at  the  price  of  poorer  approximating  functions. 

These  alternative  primal  approximation  schemes  reduce  the  solution 
of  GGP's  to  the  solution  of  a  series  of  prototype  GP's  but  leave  open 
the  choices  of  which  prototype  formulation  to  solve  and  what  solution 
algorithm  to  use.  Proposals  which  have  been  made  include: 

i)  solution  of  the  exponential  form  of  the  primal  using 
Kelley's  cutting  plane  method  [14]. 

11)  solution  of  the  transformed  using  successive  quadratic 
programming  construction  [12], 

111)  solution  of  the  transformed  primal  using  a  form  of  reduced 
gradient  method  which  employs  an  active  constraint  strategy 
to  accommodate  nonlinear  Inequalities  [10] 
iv)  solution  of  the  dual  in  which  the  linear  dual  constraints 

are  used  to  explicitly  eliminate  variables.  Templeman,  et.al. 
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[15]  used  condensation  of  the  QP  form  and  a  modified  conjugate 
gradient  method.  Jefferson  [16]  chose  the  harmonic  mean 
approximation  of  the  RP  and  a  modified  Newton  method. 

In  principle,  any  approach  suitable  for  prototype  GP's  can  be 
employed  in  conjunction  with  condensation  constructions  including 
direct  minimization  of  the  primal  approximating  problem. 

3.2  Direct  GGP  Solution 

Direct  approaches  to  the  solution  of  GGP's  can  be  of  two  types: 
direct  minimization  of  one  of  the  primal  forms  (P,  QP,  RP,  exponential, 
or  transformed)  or  solution  of  the  Kuhn-Tucker  conditions  corresponding 
to  one  of  the  GGP  formulations.  For  instance,  Lasdon,  et.al.  [17]  \ 

reported  on  the  use  of  GRG  for  direct  primal  minimization  with  some  f 

success.  Rijckaert  and  Martens  tl8]  developed  a  specialized  Newton- 
Raphson  adaptation  to  solve  the  Kuhn-Tucker  conditions  of  the  primal 
in  exponential  form.  The  linearized  equations  employed  in  the  N-R 
iterations  were  generated  using  the  condensation  construction.  Blau 
and  Wilde  [19]  solved  the  Kuhn-Tucker  conditions  of  the  dual  using  a 
specialized  N-R  method  which  exploited  the  structure  of  the  linear/ 
log-linear  equation  set  to  reduce  the  set  of  Iteration  variables. 

In  all  of  these  approaches  to  the  solution  of  GGP's^o  attempt 
was  made  to  locate  global  minima.  Attempts  along  these  lines  were 
reported  by  Passy  [20] ,  Falk  [21],  and  others  using  branch  and  bound 
procedures.  However,  no  generally  available  software  seems  to  have 
been  produced  as  yet. 


.jd 
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4.  Scope  of  This  Study 

Three  previous  comparative  studies  of  generalized  GP  solution  approaches 
have  been  reported  in  the  literature.  The  study  by  Rijckart  and  Martens  [22] 
is  the  most  comprehensive  of  the  three.  It  involved  16  generalized  GP  test 
problems,  used  up  to  five  starting  points  for  each  test  problem,  and  investi¬ 
gated  both  direct  and  sequential  approaches.  The  direct  approaches  involved 
various  Newton-Raphson  strategies  applied  to  solving  either  the  exponential 
primal,  the  dual,  or  the  transformed  dual  Lagrangian  (Kuhn-Tucker)  conditions. 
The  sequential  algorithms  considered  included  SIGNOPT  [15],  GPROG  [16]  and 
GGP  [24].  The  reported  results  indicated  that  the  direct  Kuhn-Tucker  condition 
solver  GPKTC  [25]  and  the  sequented  minimizer  GGP  were  fastest  and  most  robust. 
While  it  is  an  important  contribution,  the  study  was  flawed  in  that  different 
starting  point  generation  procedures  were  employed  for  different  codes  and  in 
that  the  time  to  achieve  a  specified  relative  error  between  successive  iterates 
rather  than  the  deviation  from  the  known  solution  was  used  as  ranking  criterion. 
Furthermore  no  attempt  was  made  to  extract  information  about  the  relative  com¬ 
putational  advantages  of  the  alternative  GGP  formulations. 

The  study  reported  by  Dembo  [5]  involved  six  generalized  GP  problems  solved 
using  a  single  starting  point.  The  codes  employed  were  GGP,  GPKTC,  GPROG,  sev¬ 
eral  additional  specialized  codes  representing  alternate  implementations  of  the 
same  sequential  strategies,  as  well  as  five  general  NLP  codes  applied  directly 
to  the  generalized  GP  primal.  Again  GGP  and  GPKTC  emerged  as  fastest  and  most 
robust.  The  test  problems  were  run  by  the  code  authors  on  their  own  machines; 
allowing  tuning  of  programs  by  the  authors;  but  requiring  that  the  solutions 
meet  fixed  tolerances.  Solution  times  were  reported  using  Colville  Standard 
times.  The  use  of  Colville  standardized  times  is  known  to  lead  to  considerable 
error  [26]  as  is  the  use  of  single  starting  points  [7],  Hence,  the  results  of 
this  study  must  be  accepted  with  considerable  reservation. 
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The  study  by  Dinkel,  et  al .  [23]  investigated  the  relative  advantages  of  the 
use  of  geometric  mean  condensation  with  the  QP  and  RP  forms  and  harmonic  mean 
condensation  with  the  RP  form.  The  posynomial  subproblems  were  solved  using 
a  Newton-Raphson  method  applied  to  the  transformed  dual.  Twelve  problems  were 
employed  and  each  was  run  with  a  single  starting  point.  The  conclusion  was 
drawn  that  the  difference  between  geometric  mean  condensation  applied  to  the 
QP  form  and  the  RP  form  was  insignificant.  The  harmonic  mean  approximation 
was  found  to  be  inferior.  This  performance  was  attributed  to  the  increased 
dimensionality  of  the  subproblem  obtained  using  the  harmonic  mean  and  the  poorer 
approximation  to  the  reversed  constraints  which  that  approximation  yields.  A 
similar  conclusion  was  reported  by  Bradley  [12]  on  the  basis  of  limited  testing 
using  this  transformed  dual  based  code. 

In  this  study  we  will  seek  to  rectify  some  of  the  experimental  inadequacies 
of  the  previous  studies.  Twenty  five  generalized  GP  problems  will  be  solved  in 
both  their  signomial  and  their  RP  forms;  using  up  to  20  different  starting  point 
replications;  code  timing  will  be  obtained  at  several  precise  error  levels  ex¬ 
cluding  phase  I  procedure  overheads.  A  series  of  experiments  will  be  included 
which  will  allow  investigation  of  primal  formulation  effects  and  of  the  relative 
merits  of  direct  primal  minimization  versus  sequential  minimization. 

Appropriate  statistical  tests  will  be  used  in  the  performance  comparisons  and 
the  correlation  between  solution  time  and  various  problem  characteristic  dimen¬ 
sions  will  be  tested. 

5.  Experimental  Procedure 
5.1  Test  Codes 

Five  test  codes  are  employed  in  this  study.  The  four  specialized 
codes  GGP  [24],  GPKTC  [25],  QDAPGP  [12],  and  DAP  [10]  as  well  as  the  general 
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NLP  Code  OPT  [27].  The  first  two  codes  were  selected  because  of  their  superior 
performance,  relative  to  other  specialized  GP  programs  employing  the  direct  or 
sequential  strategies,  in  previous  studies  [5,22],  The  second  two  codes  were 
selected  because  of  their  successes  with  posynomial  problems  in  reference  [7]. 
These  four  codes  basically  span  the  range  of  solution  approaches: 

i)  sequential  solution  using  convexified  (exponential)  primal  subprob¬ 
lems  (GGP) 

ii)  sequential  solution  -  using  transformed  dual  subproblems  (QUADGP) 

iii)  sequential  solution  using  transformed  primal  subproblems  (DAP) 

iv)  direct  solution  of  the  Kuhn-Tucker  conditions  of  the  exponential 
primal  (GPKTC) 

Moreover,  the  sequential  codes  employ  between  them  all  three  condensation 
formulations: 

i)  GGP  employs  the  QP  form  and  geometric  mean  condensation 

ii)  QUADGP  has  the  option  of  either  employing  the  QP  form  and  geometric 
mean  condensation  on  the  RP  form  and  harmonic  mean  condensation 

iii)  DAP  employs  the  RP  form  and  geometric  mean  condensation. 

The  general  purpose  GRG  based  NLP  Code  OPT  was  selected  because  its  super¬ 
ior  performance  in  a  general  NLP  comparative  study  [28]  as  well  as  its  outstanding 
performance  in  solving  posynomial  problems  in  our  earlier  study  [7],  A  round 
of  tests  were  carried  out  using  the  successive  LP  code  RALP  and  Method  of  Mul¬ 
tipliers  Code  BIAS  used  in  the  posynomial  study  [7].  However,  as  in  that  study, 
these  codes  proved  to  be  significantly  less  effective  than  OPT  and,  hence,  no 
results  with  these  codes  will  be  reported. 

5.2  Test  Problems 

For  purposes  of  this  study,  a  set  of  25  generalized  GP  test  problems  was 
selected  from  among  those  reported  in  the  previous  comparative  studies  [5,22,23], 
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various  engineering  applications  discussed  in  [9]  or  referenced  in  [3],  and 
unpublished  problems  available  to  the  authors.  The  characteristic  dimensions 
of  these  problems  are  summarized  in  Table  land  the  problem  formulations  are 
given  in  Appendix  A.  As  evident  from  the  Table  the  problems  range  from  4  to 
16  primal  variables,  1  to  12  multi-term  constraints,  and  6  to  69  primal  terms. 
Problems  with  less  than  4  variables  were  excluded  because  in  the  posynomial 
study  such  problems  often  did  not  yield  meaningful  comparative  data.  With  short 
run  times,  program  overheads  dominate  the  rankings.  The  upper  end  of  the  test 
problem  size  range  was  limited  by  the  size  of  the  RP  form  which  could  be  accom¬ 
modated  by  some  of  the  codes.  In  transforming  a  signomial  problem  to  RP  form, 
two  variables,  two  constraints,  and  two  terms  are  added  to  eliminate  a  signomial 
objective  function  and  one  variable,  one  constraint,  and  one  term  are  added  in 
converting  each  signomial  constraint.  Consequently,  as  shown  in  Table  2,  trans¬ 
formation  will  frequently  more  than  double  the  exponent  matrix  size  (e.g.  see 
problems  3,8,14,19,24-26).  All  of  the  codes  used  in  this  study  are  written  for 
dense  matrices  and  do  not  employ  storage  saving  (sparse  matrix)  methods.  Thus, 
in  the  posynomial  study  [7],  problems  with  exponent  matrices  exceeding  2000 
elements  typically  could  not  be  run  within  the  150  K  octal  word  memory  limit 
set  on  the  Purdue  system.  As  it  is,  several  of  the  25  problems  could  not  be 
run  in  RP  form. 

5.3  Testing  Conditions 

The  basic  testing  procedure  followed  that  employed  in  the  companion  study 
[7];  hence,  it  will  be  reiterated  here  only  in  outline.  The  key  elements  of 
the  experimental  design  are  the  use  of: 

i)  Fixed  code  parameters. 

After  selective  tests  to  study  the  effects  of  code  parameters,  a 

fixed  set  of  parameters  was  chosen  for  use  in  all  subsequent  testing. 
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The  code  parameters  are  given  in  Appendix  C. 

ii)  Feasible  starting  points. 

In  order  to  separate  algorithm  performance  from  the  effectiveness 
of  various  phase  I  procedures,  only  feasible  points  were  used. 
Admittedly,  in  practice  the  costs  of  generating  starting  points  can 
be  significant;  however,  a  thorough  investigation  of  this  question 
is  a  major  study  in  itself. 

iii)  Multiple,  randomized  starting  points. 

As  in  [7],  up  to  20  starting  points  were  generated  for  each  test 
problem  both  in  the  signomial  and  the  RP  form.  The  points  were  gen¬ 
erated  by  random  sampling  from  the  surface  of  an  N-dimensional  sphere 
whose  center  is  the  actual  problem  optimal  solution.  Normally,  two 
different  radii  were  used  and  only  the  feasible  points  retained. 

In  some  cases,  because  the  feasible  region  was  very  tightly  constrained, 
it  was  not  possible  to  generate  a  full  compliment  of  sufficiently 
distinct  feasible  points  even  after  1000  sec  Cpu  time  (CDC  6500). 

In  such  cases  a  third,  shorter  radius  was  used.  The  number  of  start¬ 
ing  points  used  for  each  problem  in  its  signomial  form  are  summarized 
in  Table  3A;  the  number  used  for  the  RP  form  in  Table  3B. 

iv)  Pseudo-Lagrangian  error  function  to  measure  solution  accuracy. 

The  function  used  is, 

n  *  n  _  * 

ABS[(9°  -«--P  )  +  n*  abs ( ~m  — 9(ri-  )] 

%  m  90 

where  g*.  q*,  A*  are  the  values  of  the  objective  function,  constraints, 
3o  m  m 

and  multipliers  at  the  optimum. 

The  sum  over  m  only  includes  the  constraints  active  at  the  optimum 


solution. 


v)  Performance  data  accumulation  at  specified  error  levels. 

Intermediate  solution  times  were  obtained  at  error  function  values 
-2  -3  -4  -5 

of  10  ,10  ,10  ,  and  10  .  Means  and  standard  deviations  were 

computed  for  the  runs  with  each  code-problem  combination. 

As  described  in  [7],  the  testing,  data  accumulation,  and  statistical  analy 
sis  of  the  resulting  performance  data  were  automated  to  a  large  degree  using 
appropriate  pre-  and  post-processing  programs,  as  well  as  an  efficient  system 
of  problem,  starting  point,  intermediate  result,  and  reduced  data  files.  A 
typical  intermediate  data  summary  for  a  test  problem  run  is  shown  in  Fig.  1. 
Note  that  mean  times  and  standard  deviations  are  calculated  only  for  successful 
runs.  All  runs  were  carried  out  on  the  Purdue  University  dual  CDC  6500  System 
with  its  MACE  operating  system  using  the  MNF  (Version  5.3)  compiler. 

5.4  Test  Runs 

The  runs  were  grouped  into  two  main  test  series;  alternate  minimization 
strategies  employing  OPT  and  solution  using  the  specialized  GP  codes.  The  OPT 
runs  were  grouped  into  two  sub-series,  identified  as  follows: 

A)  Direct  Minimization 

1.  Signomial  form  of  the  primal  (0PTPD) 

2.  Signomial  form  of  the  exponential  primal  (0PTCPD) 

3.  Signomial  form  of  the  transformed  primal  (0PTTPD) 

4.  Reversed  form  of  the  exponential  primal  (0PTCPR) 

B)  Sequential  Minimization 

Sequential  Solution  of  the  RP  using  convex  (exponential)  primal  sub¬ 
problems  (0PTCPS) 

The  specialized  generalized  GP  runs  consisted  of  the  following: 
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1.  Direct  solution  of  the  exponential  primal  KT  conditions  (GPKTC) 

2.  Sequential  solution  of  the  QP  using  convex  primal  subproblems  (GGP) 

3.  Sequential  solutions  of  the  transformed  primal  (DAP) 

4.  Sequential  solution  using  transformed  dual  subproblems  in  two  series: 

QP  form  and  geometric  mean  condensation  (designated  BRADAW)  and  RP 
form  using  the  harmonic  mean  condensation  (designated  BRADHA). 

A  total  of  ten  test  series  will  thus  be  reported. 

6.  Results 
6.1  Primary  Data 

The  primary  data  for  the  ten  test  series  can  be  condensed  to  four  tables. 

Table  4  indicates  the  number  of  runs  attempted  and  successfully  solved  for  each 

-2 

series.  A  run  was  deemed  successful  if  it  reached  the  10  error  level.  A  run 

_2 

was  labelled  unsuccessful  if  either  it  did  not  reach  the  10  error  level  or 
the  problem  could  not  be  run  because  the  memory  requirements  exceeded  the  150K 
octal  maximum  allowed  on  the  Purdue  University  system.  As  evident  from  the  Table 
there  were  338  possible  runs  per  series  if  the  code  used  the  signomial  form  input 
files  and  274  possible  runs  per  series  if  the  code  used  the  RP  data  files.  The 
smaller  number  in  the  RP  case  arises  because  the  increased  size  of  the  PR  form 
problems  prohibited  solution  of  some  of  these  problems  (8,24,26)  or  forced  a 
reduction  in  the  number  of  sufficiently  different  starting  points  which  could  be 
generated. 

The  most  startling  result  evident  from  the  table  is  the  generally  higher 
level  of  unsuccessful  runs,  especially  by  the  specialized  codes,  when  compared 
to  the  %  unsuccessful  attempts  obtained  in  the  posynomial  study  [7].  For  in¬ 
stance,  GGP  8.0%  versus  4%;  GPKTC  51%  vs.  41%;  DAP  90.5%  vs.  3.5%;  and,  QUADGP 
60%  vs.  9%.  The  OPT  runs  also  exhibit  this  trend:  primal  solution  27.8  vs. 

6.8%;  convex  (exponential)  primal  3.3%  vs.  0.16%;  and  transformed  primal  38.8% 
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vs.  27.4%.  These  results  seem  to  indicate  that  the  non-convexity  of  the  sig- 
nomial  problems  does  in  fact  make  them  more  difficult  to  solve.  This  conclu¬ 
sion  is  a  tenuous  one,  however,  because  the  signomial  problems  used  in  this 
study  may  simply  constitute  a  subset  of  more  difficult  problems  and  thus  may 
not  be  representative  of  the  class  as  a  whole. 

The  mean  times  in  CP  seconds  and  number  of  successful  runs  upon  which  these 

means  are  based  for  the  ten  series  are  given  in  Tables  5A,  5B,  and  5C.  Results 

-2  -T  -4 

are  separately  tabulated  for  the  10  ,10  ,  and  10  error  leads.  Results  are 

not  shown  for  the  10”^  error  level  because  with  the  code  parameter  values  selec- 

-4  -5 

ted  in  this  study  most  runs  terminated  at  error  levels  between  10  and  10  . 

As  can  be  seen  from  Tables  5A  through  5C,  two  problems  (24  and  28)  could 
not  be  solved  by  any  code  from  any  starting  point.  Moreover,  several  problems, 
noteably,  8,14,  and  18,  were  only  solved  in  a  few  of  the  series.  A  cursory 
study  of  the  mean  times  indicates  that  GGP  generally  performed  best,  followed 
by  OPTCPD,  with  occassionally  very  good  times  by  the  QUADGP  series,  BRADAW  and 
BRADHA.  Standard  deviation  values  corresponding  to  the  reported  mean  times  are 
not  listed  separately.  However,  they  are  used  in  the  Student's  t  tests,  the 
results  of  which  will  be  detailed  later.  Since  standard  deviation  values  ty¬ 
pically  ranged  from  50?£  to  10%  of  the  magnitude  of  the  mean,  a  rigorous  comparison  of 
mean  solution  times  must  take  the  standard  deviations  into  account. 

6.2  Analysis  of  Primary  Oata 

In  order  to  compare  the  mean  times  of  alternate  run  series,  a  modified 
Student  t  test  was  employed  as  described  in  [7].  This  test  assumes  that  the 
solution  times  for  two  series  for  any  given  problem  are  normally  distributed 
each  with  its  own  variance.  Code  time  comparison  is  then  equivalent  to  testing 
whether  the  true  mean  times  are  equal.  A  90%  significance  level  will  be  required 
before  means  will  be  considered  to  be  different.  These  comparisons  will  be 
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presented  in  six  groupings: 

1.  OPT  Direct  Primal  Form  Minimization 

2.  OPT  Strategies  involving  the  Exponential  (Convexified)  Primal 

3.  Convexified  (Exponential)  Primal  Strategies 

4.  Harmonic  vs.  Geometric  Means 

5.  Transformed  Primal  Strategies 

6.  Overall  Comparison 

For  the  first  set  of  comparison,  the  three  series  in  which  OPT  is  used 

to  directly  minimize  the  signomial  problem  in  its  primal,  exponential  primal, 

and  transformed  primal  form  will  be  considered.  As  shown  in  Tables  6A,  6B, 

-2  -3  -4 

6C  at  the  10  ,  10  ,  as  well  as  the  10  error  levels,  the  exponential  primal 
approach  is  faster  at  virtually  1 00%  significance  level  in  23  out  of  23  cases, 

20  out  of  22  cases,  and  15  out  of  18  cases  respectively.  This  dominance  is 
quite  substantial:  from  Table  5A,  for  instance,  the  ratio  of  mean  times  of 
0PTPD/0PTCP0  is  always  at  least  2,  often  5  or  more,  and  sometimes  10  or  more. 
These  results  are  similar  to  those  observed  in  the  posynomial  case. 

In  the  next  set  of  comparisons,  the  three  OPT  series  involving  the  use 
of  the  exponential  primal  form  in  direct  signomial  solution  (OPTCPD),  direct 
reversed  posynomial  solution  (OPTCPR)  and  sequential  reversed  posynomial  solu¬ 
tion  (OPTCPS)  will  be  tested.  From  Tables  7A,  B,  and  C  it  is  evident  that  at 
all  three  error  levels  direct  signomial  solution  dominates:  in  23  of  23  cases 

at  10-2,  in  20  of  21  cases  at  10-2,  and  in  15  of  18  cases  at  10  2.  This  also 

is  not  surprising  in  view  of  the  larger  dimensionality  of  the  reversed  form 
relative  to  the  signomial  form.  For  problems  with  larger  dimensionality  differ¬ 
ences  (3,5,10,14,18,19,20,21 ,25)  the  mean  time  ratios  often  exceed  four.  It 
is,  however,  interesting  to  note  from  Tables  5A,  B,  and  C  that  the  sequential 

and  reversed  times  are  generally  fairly  close  to  each  other.  Since,  the  OPT 

sequential  implementation  does  not  take  advantage  of  the  single  term  constraints 
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generated  by  condensation,  this  indicates  that  sequential  solution  can  readily 
be  made  more  efficient  than  direct  solution. 

A  cross  comparison  of  three  series  which  use  the  exponential  (convexified) 
primal:  the  OPT  Sequential  series  which  uses  the  RP  form,  GGP  which  uses  the 
QP  form  for  sequential  solution,  and  GPKTC  which  solves  the  Kuhn-Tucker  condi¬ 
tions  is  given  in  Tables  8A,B,C.  GGP  dominates  overwhelmingly  with  OPTCPS  gen¬ 
erally  second.  GPKTC  does  not  appear  to  be  competitive,  primarily  because  of 
frequent  failure  to  converge.  When  it  does  converge,  it  apparently  has  no  diffi¬ 
culty  achieving  high  accuracy  solutions.  Note  that  the  principal  difference 
between  GGP  and  OPTCPS  lies  in  the  dimensionality  of  the  convex  primal  subproblem 
which  is  solved  and  in  the  treatment  of  single  term  constraints.  Because  GGP 
uses  the  QP  form  while  OPTCPS  uses  the  RP  form,  the  GGP  condensed  subproblem 
will  always  be  smaller  in  both  variables  and  number  of  constraints.  Moreover, 
in  GGP  single  term  constraints  are  converted  and  treated  directly  as  linear 
constraints  while  in  OPTCPS  this  was  not  done.  This  comparison  thus  clearly 
indicates  that  condensation  of  the  QP  form  is  to  be  preferred. 

Next  we  compare  the  difference  between  condensation  using  the  geometric 
mean  and  condensation  using  the  harmonic  mean.  In  series  BRADAW  and  BRADHA, 
the  solution  of  the  posynomial  subproblems  is  carried  out  in  the  transformed 
dual  using  QUADGP.  As  evident  from  Tables  9A,  B,  and  C,  the  performance  of  the 
two  strategies  is  generally  similar  despite  the  differences  in  the  dimension¬ 
ality  of  the  associated  subproblems.  The  geometric  mean  series  dominates  in 
10  of  17  cases  at  the  10"2,  level,  9  of  14  cases  at  the  10'3  level,  and  8  of  13 
cases  at  the  10”^  level.  These  results  seem  to  anomalous  in  view  of  the  substan¬ 
tial  dominance  of  the  geometric  mean  approach  reported  in  [23]  and  [12]. 

Next,  the  two  transformed  primal  series  are  compared.  DAP  uses  the  trans¬ 
formed  primal  and  condenses  the  reversed  constraints.  In  the  OPTTPD  series  the 
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transformed  primal  is  minimized  directly.  Tables  10A,  B,  and  C  indicate  that 

OPT  is  faster  in  12  of  21  cases  at  the  ID-2  level,  12  of  19  cases  at  the  10"^ 

-4 

level,  and  10  of  14  cases  at  the  10  level.  This  despite  the  fact  that  DAP 
exploits  single  term  constraints.  In  general  DAP  proved  unreliable  in  solving 
signomial  problems,  in  startling  contrast  to  its  performance  in  the  posynomial 
study. 

Finally,  we  will  use  the  Student  t  test  to  perform  an  overall  comparison 
of  all  ten  series.  As  shown  in  Tables  11  A,  B,  and  C,  the  6GP,  OPTCPD  and  the 
QUADGP  series  dominate  the  rankings.  GGP  is  first  in  13  of  23  cases  at  the 
10”2  level,  12  of  23  cases  at  10”2,  and  10  of  21  cases  at  10"^.  The  performance 
of  the  two  QUADGP  series  (BRADAW  and  BRADHA)  is  quite  close:  when  one  is  first,  the 
other  invariably  is  a  close  second.  It  is  important  to  note,  however,  that  the 
problems  in  which  the  QUADGP  times  rank  first  are  precisely  those  in  which  the 
degree  of  freedom  of  the  condensed  problem  is  much  less  than  the  number  of  primal 
variables.  Specifically,  for  problem  1,  the  condensed  degree  of  freedom  is  1; 
for  problem  15,  it  is  1;  for  problem  16,  3;  for  problem  17,  4;  for  problem  20, 

2;  and  for  problem  21,  it  is  4.  For  the  other  problems  the  degree  of  freedom  is 
much  larger  than  the  number  of  primal  variables  and  for  none  of  these  is  QUADGP 
competitive  with  GGP  or  OPTCPD.  In  view  of  this  factor  and  from  the  summary 
given  in  Table  12,  it  appears  that  OPTCPD  can  be  ranked  second  on  the  basis  of 
its  numerous  second  best  times,  while  QUADGP  is  third  only  in  the  basis  of  the 
above  six  problems. 

6.3  Effect  of  Problem  Dimension  on  Solution  Time 

To  help  clarify  which  generalized  GP  problem  characteristic  could  best  be 
used  as  measure  of  solution  difficulty,  correlation  coefficients  were  computed 
between  the  problem  solution  time  and  each  of  eight  problem  characteristics. 
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Since  each  such  correlation  coefficient  only  involves  data  from  the  same  code 
run  with  the  same  set  of  program  parameters,  the  mean  termination  time  of  a  run 
was  used  as  the  characteristic  problem  solution  time.  The  resulting  correla¬ 
tion  coefficients  are  summarized  in  Tables  13  and  14.  In  the  former  it  is 
assumed  that  time  is  to  the  exponential  of  the  particular  problem  character¬ 
istic;  in  the  latter,  a  direct  linear  relation  is  assumed.  The  last  column  of 
both  Tables  lists  the  critical  correlation  coefficient  value  for  a  0.05  signi¬ 
ficance  level. 

From  the  tables  it  is  evident  that^for  direct  primal  solution  (OPTPD),  there 
is  a  stronger  correlation  of  time  to  the  exponential  of  the  number  of  primal 
variables  and  number  of  multi-term  constraints  than  to  the  corresponding  linear 
relationships.  Moreover,  the  correlation  is  considerably  higher  to  the  number 
of  multi-term  constraints  than  to  either  the  total  number  or  number  of  tight 
constraints.  On  the  other  hand,  the  linear  correlation  to  the  number  of  primal 
terms  and  negative  terms  is  stronger  than  the  exponential.  The  correlation 
to  the  number  of  terms  apparently  reflects  the  effort  involved  in  function  eval¬ 
uations,  while  that  to  the  negative  terms  could  well  reflect  some  measure 
of  the  difficulty  introduced  by  these  non-convex  elements. 

For  direct  exponential  primal  solution  (OPTCPD),  the  exponential  form 
correlation  coefficients  for  the  number  of  variables,  number  of  multi-term  con¬ 
straints,  and  number  of  tight  constraints  are  highest  and  very  nearly  equal. 

The  linear  coefficient  is  higher  than  the  corresponding  exponential  only  for 
the  number  of  negative  terms.  The  correlation  to  the  number  of  terms  weakens, 
possibly  because  in  the  exponential  primal  term  evaluations  are  less  time  con¬ 
suming. 

The  reversed  exponential  primal  (OPTCPR)  correlation  coefficients  are  highest 
for  the  exponential  of  the  number  of  variables,  number  of  multi-term  constraints. 
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and  number  of  primal  terms.  The  first  two  correspond  to  the  results  obtained 
for  the  primal  and  exponential  primal.  The  reason  for  the  emergence  of  the 
latter  is  not  obvious.  Also,  anomalous  is  the  negative  correlation  coefficient 
for  the  number  of  tight  constraints.  The  strong  linear  correlation  to  the 
number  of  reversed  constraints  apparently  indicates  that  this  measure  of  non¬ 
convexity  is  a  significant  measure  of  problem  difficulty,  since  its  value  is 
much  larger  than  the  linear  coefficient  for  both  total  number  of  constraints 
and  number  of  multi-term  constraints. 

The  transformed  primal  results  indicate  very  strong  correlation  to  the 
number  of  terms  and  degree  of  difficulty.  Since  the  latter  is  related  to  the  former, 
the  number  of  terms  is  clearly  the  significant  parameter.  The  total  number  of 
constraints  also  .ias  a  stronger  exponential  correlation,  while  the  number  of 
reversed  constraints  has  a  stronger  linear  correlation.  These  results  are  reas¬ 
onable  because,  in  the  transformed  case,  the  number  of  actual  problem  variables 
is  equal  to  the  number  of  terms.  In  this  case,  the  number  of  reversed  constraints 
also  apparently  acts  as  measure  of  problem  difficulty  arising  from  nonconvexities. 
Thus,  the  results  for  the  transformed  and  reversed  primal  complement  each  other 
in  this  regard. 

For  sequential  transformed  dual  solution  (BRADAW)  the  key  exponentially 
related  properties  are  the  degree  of  difficulty  and  the  number  of  primal  terms. 

The  latter  is  equal  to  the  number  of  transformed  dual  constraints  wh.  2  the 

former  is  a  measure  of  the  number  of  transformed  dual  variables.  The  strongest 

linear  correlation  is  to  the  number  of  primal  constraints.  This  is  not  unreas¬ 
onable. since  the  number  of  primal  constraints  does  not  directly  influence  the 
dimensionality  of  the  transformed  dual  -  it  only  adds  to  the  complexity  of  the 
objective  function.  Anomalously,  although  the  problem  negative  terms  impose 
the  need  for  sequential  solution,  the  correlation  with  respect  to  that  para¬ 
meter  is  not  significant. 


For  direct  solution  of  the  exponential  primal  Kuhn-Tucker  conditions 
(GPKTC),  the  correlation  is  strongest  to  the  exponential  of  the  number  of  primal 
variables,  constraints,  and  multi-term  constraints.  Since  the  primal  variables 
and  linearization  weights  for  the  multi-term  functions  are  the  primary  iteration 
variables  in  the  Newton-Raphson  algorithm,  the  observed  strong  correlation  can 
be  rational ized.  The  stronger  linear  correlation  to  the  number  of  primal  con¬ 
straints  may  reflect  the  fact  that  the  constraint  multipliers  are  less  signifi¬ 
cant  variables  in  the  iterations  since  they  enter  linearly. 

Finally,  consider  the  sequential  approaches  using  convex  primal  subproblems. 
The  sequential  QP  series  (GGP)  indicates  a  strong  exponential  correlation  to 
only  the  primal  variables.  Curiously  there  is  no  significant  correlation  to 
either  the  number  of  negative  terms  or  the  number  of  tight  constraints.  In  the 
sequential  RP  series,  the  correlations  to  the  number  of  primal  variables  and 
multi-term  constraints  are  strongest  for  the  exponential  relation,  while  those 
for  the  number  of  constraints,  number  of  primal  terms,  and  number  of  reversed 
constraints  is  strongest  for  the  linear  relation.  These  results  are  consistent 
with  those  obtained  for  direct  signomial  exponential  primal  and  reversed  expo¬ 
nential  primal  solution.  The  stronger  linear  correlations  to  the  number  of 
reversed  constraints  again  suggests  that  this  parameter  may  be  a  valid  measure 
of  generalized  GP  problem  difficulty. 

7.  Conclusions 

On  the  basis  of  the  results  of  this  comparative  study,  it  can  be  concluded 
that,  given  the  computational  state  of  the  art  represented  by  the  test  codes 
employed  in  this  study,  the  preferred  solution  approach  for  generalized  GP's 
involves  the  following  elements: 
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i)  use  of  tne  quotient  form  of  the  signomial  functions 

ii)  condensation  of  the  denominators  of  the  quotients  using  the  geometric 
mean  construction 

iii)  solution  of  the  condensed  subproblems  in  their  convexif’ed  primal  form. 

The  best  method  which  should  be  employed  for  the  subproblems  minimizations 

is  not  obvious  from  the  results  of  this  study.  The  Kelley’s  Cutting  Plane  method 
employed  by  the  best  code  in  this  study  (GGP),  obviously  performs  superlatively. 
However,  in  the  posynomial  study  [7],  the  general  purpose  GRG  Code  OPT  proved 
at  least  as  effective  as  GGP  in  solving  prototype  GP  problems  even  without  incor¬ 
porating  devices  appropriate  for  GP's  which  would  enhance  its  effectiveness. 

A  separate  test  series  in  which  OPT  was  used  within  a  strategy  employing  the 
above  three  elements  was  not  executed  in  this  study  because,  on  the  basis  of  the 
evidence  accumulated,  the  results  were  clearly  predictable.  Hence,  the  cost  of 
developing  additional  problem  formulation  files  and  conducting  another  full 
test  series  was  not  justifiable.  Since  direct  OPT  minimization  of  the  exponen¬ 
tial  primal  was  second  only  to  GGP  in  effectiveness  and  since  sequential  OPT 
minimization  of  reversed  exponential  primal s  was  at  least  as  effective  as  direct 
minimization  of  reversed  exponential  primal,  it  follows  that  sequential  QP  mini¬ 
mization  using  OPT  will  be  competitive  with  GGP. 

It  is  furthermore  clear  that  a  variation  of  the  above  strategy  which  com¬ 
bines  quotient  form  condensation  with  transformed  dual  subproblem  solution  will 
be  effective  for  problems  in  which  the  degree  of  freedom  is  much  smaller  than 
the  number  of  primal  variables.  Since  in  practice  it  is  normal  to  impose  upper 
and  lower  variable  bounds  and  multiple  constraints  when  formulating  models,  the 
practical  significance  of  the  above  subclass  of  generalized  GP  problems  appears 
to  be  small . 

The  correlation  coefficient  analysis  performed  in  this  study  indicates  that 
the  primary  exponential ly  correlated  problem  characteri Stic  is  the  number  of 
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variables  in  the  problem  formulation  being  solved.  For  primal  approaches  the 
number  of  multi-term  constraints  also  is  strongly  exponentially  correlated.  For 
signomial  form  problems  solved  in  the  various  primal  formulations,  the  solution 
time  is  strongly  correlated  to  the  number  of  negative  terms.  For  reversed 
posynomial  problems  solved  in  the  various  primal  formulations,  the  solution  time 
is  generally  strongly  correlated  to  the  number  of  reversed  constraints.  It 
thus  appears  that  in  judging  the  difficulty  of  a  generalized  GP  the  number  of 
variables  and  multi-term  constraints  is  more  significant  than  the  number  of 
negative  terms  or  reversed  constraints. 
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PROBLEM  14-1 


OBJ  FUNC  -  -3. 77970732E+02 

ERF  TIME  A.  ERF 

3.10859262E-06  1. 18560000E+01  B.33939008E-OS 
-4.3S9G3677E-05  1.04100000E+01  1 . 02S75373E-04 
-4 , 95658933E-0B  1.31B30000E+01  3.86761749E-0S 
8.81929268E-05  1.21470000E+01  1 . 845B4869E-04 
4.09208848E-0B  1.20060000E+01  2.5B980454E-05 
B.B23565B4E-0G  1.12550000E+01  1 .520B080BE-D5 
8. 00077784E-0G  1. 17990000E+01  1 .G2907410E-05 
3.98691867E-0S  9.36600000E+00  7.S3403142E-05 
3.0901305BE-05  1. 19790000E+01  6. 1827GS97E-05 
2.25150681E-05  1.41390000E+01  4.50254447E-05 
FINAL  VALUES*  AUE. ERROR  ®  1.54750555E-05  STAN.  DEU.  3.414B8945E-05 
FIMAL  VALUES*  A. AUE. ERROR  =  5.75644B93E-05  STAN.  DEU.  5.40654154E-05 

FINAL  VALUES.  AUE. TIME  =  1. 18120000E+01  STAN.  DEU.  1.31988021E+00 
.01000  NO.  PTS.=  10  MEAN  TIME=  5.41581GG1E+00  STANDARD  DEV.®  8.G4575516E-01 

.00100  NO.  PTS.®  10  MEAN  TIME®  7.2290084SE+00  STANDARD  DEU.®  9.5G717259E-01 

.00010  NO.  PTS.®  9  MEAN  TIME®  8.20045084E+00  STANDARD  DEU.®  1 . 18815908E+00 

.00001  NO.  PTS.®  1  MEAN  TIME®  8.G1237092E+00  STANDARD  DEV.®  0 


Fig.  1.  Typical  Intermediate  Result  Summary  for  a  test  Problem  run. 
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Table  4:  Number  of  Solutions  Attempted  and  Solved 
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Table  6.  Student  t  Comparisons:  OPT  Primal  Approaches 
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11 

OP  TCP-0 

-P T  CPR 

70.173 

1.867 

-  13.208 

ioo. ood—^ 

92.404  * 

12 

OPTCPO 

OPTCPS 

20.928 

12 

OPTCPO 

CPTCPR 

9.243 

•  21.817 

100.000 

10 

OPTCPO 

OPTCPS 

32.697 

6.001 

100.000 

14 

15 

OPTCPD 

OPTCPO 

CPTCPS 

0°T  CPS 

580.218 

1  37,274 

,  13.000 

23. 259 

16 

OPTCPO 

OPTCPS 

42. 744 

28.637 

100.000 

17 

OPTCPO 

C°TCPS 

86.500 

20.730 

100.000 

18 

19 

OPTCPO 

OPTCPO 

CPTCPR 

OPTCPS 

22.631 

200.096 

•  -  4:114:.. 

^ilo'ooJ-^ 

20 

OPTCPO 

OPTCPS 

0 

0 

100.000 

21 

OPTCPO 

OPTCPS 

0 

0 

100.000 

22 

-23 

OPTCPO 

OPTCPO 

CPTCPO 

OPTCPR 

0 

86  .  777 

0 

27.641 

*  T'-jl  j* 

25 

OPTCPO 

0°T  CPR 

562.854 

9.000 

700.000 

^tSifL^LH-VI?^5 


PR08LEM 

NUMBER 


CODE  WITH 
BEST  <*V 8. 

tIme 

OP TCP  O 
OPTCPO 
OPTCPO 
OPTCPO 
OPTCPO 

«PTCP 0  . 
°TCPO 
OPTCPO 
OPTCPO 
■  GPTCP.U 
•  OPTCPO 
OPTCPO 
OPTCPO 
OPTCPO 
OPTCPO 


NEXT  -tEST 
CC2E 


GP  T  CPS 
CPTCPR 

OPTCPS 

CPTCPR 

OPTCPS 

OPTCPR 

'QPTCPP 

CPTCPR 

OPTCPS 

OPTCPO 

OPTCPR 

OPTCPS 

CPTCPO 

OPTCPS 

OPTCPS 


STUDENTS 
T  VALUE  -- 


48.144 

00.171 
26.992 
407.25b 
551.989 
50.107 
95.  24 S'" 
76. 958 
303.266 
2.101 
11. 739  * 
22, 963 
0 

30.953 

35.223 


F R££Q 0M~~.. 1-E  VEL-. QJE  -Oil 

i*.  *-tO  .,'>*•  >«.  i  raftUi*  M**e*  •  -  .^^‘7 

22.062  10  0.000  " 

t?:i*fcs.t2sijUU|-  ... 


Ef «.» .... 


,05.695 
19.000 
26.5 76 
19.727- 
0.625 
16.000 


100.000 

100.000 


100.000 

100.000 


100.000 


0  100.000 

iS: 


17 

OPTCPO 

OPTCPS 

100.043 

19.921  - 

100.000 

19 

OPTCPD 

OPTCPR 

441.208 

4.  000 

100*066 

it 

. ^OPTCPS 

N>*TC*0 

CPTCPS 

OPTCPS 

i- 

- 

22 

OPTCPO 

OPTCPO 

0 

0 

100.000 

100.000 

23 

OPTCPO 

CPTCPR 

68.721 

28.907 

25 

OPTCPO 

CPTCPR 

1661.446 

9.000 

,JOA40I 

. . . 

able  7.  Student  t  Comparisons:  OPT  Convex  Primal  Approaches 


*>•  ono  o>4<m  iT) 


1 1MML”  STUOI'JT  T r  i  T  (■  .  -■  Ul  T  -> 
IRiLIT :»/-  :."i)0a  !•_-<♦) 


/ 


PROBLEM 

NUMrit.- 


C->>:  *IT*  N  *  T 
jT  -*  V  d  •  L  l  J  _ 
T  t  US’ 


H"jT  STuO^NTS 

r  w  -l  u£ 


o-:s»Ec;  op 

FRtiOwH 


SIGNIFICANCE 
lLVLL  Of  DIFl 


op  r  cp  o 
JPTCPd 
OPTCPO 
opt cpc 
optcpo 
cpicpo 

OPTCPO 

OPT  CP  3 
OP  T  CP  0 


OPTCPO 
OPTCPO 
O^TCPJ 
0  °  T  CP  B 
OPTCPO 
OP TCPR 
CPTCPR 
OPTCPO 


CP  TCP  ) 
CPTCFj 

OPTCPO 

0 

1 

CP  T  CPP 

020.659 

OPTCPO 

0 

w?T 

OPTCPO 

id. 

w P  T CP-. 

0 

Cr-T.P1 

0 

CP  T  CPC 

,8:884 

CP  TC  PS 

OP  TCP- 

0 

OP  TCP- 

0 

Of  r  cp* 

6 7.214 

CPTCPB 

0 

CPTwPf- 

0 

OP  TCPQ 

0 

Of  T  l.PH 

OP  T  C  PP 

20. 967 

0 


! 

>7 
0 

12.  U/j 

*4 

0 

6.624 

4-000 

4.  000 

i.iii 


190.000 

W:Si8 

188:888 

.  t88:888 

188:888 

99.993 

100.000 

100.00Q 

100.000 

100.000 

s 

100.000 

99.924 

100.0ft 


Table  7.  Student  t  Comparisons:  OPT  Convex  Primal  Approaches 


►*OBLEN 

NUHdEH 


c.?e  kith 

d--*T  10  d« 

TIHf 

0»  TCP  S 

GGP 

G5«» 

GGP 

GGP 

GUP 

GGB 

GGP 

GGP 

GGP 

SSP 

GG-> 

G'j  b 
GGP 
GGP 
GGJ 

GGP 

GGP 

GGP 

GGJ 

GGP 

6PKTC 

GP<  TC 


VTKT  *^.GT 


GiP 

GPKIC 

OPTCPS 

OPTCPS 

•OPTCPS 

cptcps 

6GP 

jP’.PS 

0»TCPS 

CPTCFG 

OPTCPS 

JPTCPJ 

3PTCPS 

C*  T CPS 

C  P  T  C  P  S 

wPTC-0 

■Sit. 

OPT CPS 
GPKTC 

-J  TCPj 
SGP 

TC 

OPTCPS 

UP n  TC 


STUO'NTS 
”  01LUE 


15.345 
65. 19S 
47.421 
1 32.361 
2715.364 
44.316 


DEGREE  OF 
P-.viiOJM 


SIGNIFICANCE 
~-.Li.VLu  OF  OIFF 


4  3.  0t>3 
41.579 
42. C90 
25. 733 
65.373 
1  ->*4. 268 
107.013 
44.342 

t»  5  2.  57  7 
0 
0 
0 

22.176 

.*»74 

0 


27.202 

19.485 

19.000 

****|, 
Id. 123 
2.646 
20. 91* 
10. 993 
4.160 
13.000 
39. 900 
23.502* 
35.  938 
0 

5.004 

0 

0 

0 

17.373 

1.005 


100.000 

■  IffcM 
100.000 
100.000 

100.000 

100.000 

MI:NI 

100.000 

100.000 

100.000 

100.000 

100.000 

100.000 

188:881 

100.000 

100.000 

lOO.OOg 

iooTooo 


P008L-  M 


coo-: 


KITH 
**0  0. 


OP  TCP  S 

ggp 

GG  P 

66  P 
GG° 

GGP 

G«p 

GGP 

GGB 

GGP 

GOP 

GGP 

GGP 


next 

C 


Gi*  P 

GPkTC 

GP0TC 

GP<TC 

OPT  CPS 

CPTCPS 

OPTCPS 

GGP 

OPTCPS 

GGP 

OPTCPS 

OPTCPS 

OPTCPS 

GGP 

OPTCPS 

0° TCPS 
CP  T  CPS 

^TCPS 
OPTCPS 
OPTCPS 
6  6£ 

6PKTC 


STuOTNTS 
T  I/AlGE 


14.  72 1 

«??:& 

**■«:«?* 
.  o 

34.  596 

57.  347 
3 

M»9S6 

42.  68$ 
22.401 
56.  81b 

2053.044 

0 

0 

0 

17.140 


degree  of 
FREEDOM 

34.141 

tfcffli 

29.432 

19.112 

*1:111 

o 

10.169 

10.000 

10.231 

4.017 

34.3  fti  " 

27. 536 
36. 778 

5.00$ 

0 

0 

0 

21.445 


SIGNIFICANCE 
tcWtc  OF  OXFC^I 

100.000 

n-M 

100.000 

100.000 

iU:M 

100.000 

100.000 

tl$:W  . 

t  SMSS 

-mm  ■*  . 

100. 000 

100.000 

Mfcttl 

100.000 

100.000 

til:m  •  .v 


StudenT  t  Comparisons:  Convexlfled  Primal  Strategies 


f»ch  o>-i04to.ir  'tW'  o-«fOi*} 


C  SAMPLE 

l  R£L  A 


problem 

NUMBER 


T?iF:«onr-fi?uLTs 


COO*  WITH 

NE«T  bEST 

STUDENTS 

DEGREE  OF 

SIGNIFICANCE 

BEET  AW b. 

C  CUE 

T  VALUE 

FREEDOM.-.- 

LEVEL  OF  OIF.  1  » 

time 

••  -- 

.  .  .i.  ** 

GGP 

G»KTC 

43. 261 

36.869  ‘ 

100.000 

GPKTC 

GGP 

IS. Sib 

16.644 

100.000  ,, 
100.000 

GGP- 

GPKTC 

66.  794 

31.154 

GGP 

OPTCPS 

68.  311 

5»  004 

100.000 

GGP 

GGP 

0 

0 

100.000 

GGP 

GGP 

OP  T  CPS 

GPKTC 

136.56? 

4.476 

kffi 

*88:888  - 

GGP 

GGP 

0 

0 

ioo.ooo 

GGP 

GGP 

0 

0 

100.000 

GGP 

OPTCPG 

54.245 

7.06? 

ioo.ooo  . . 

-  GGP 

CPTCPS 

3113.649 

19.000 

100.800 

GUP 

GGP 

0 

0 

100.000 

GGP 

GPKTC 

14.135 

5.272 

x  100.000 

GGP 

OPT  CPS 

3.357 

2.367 

97.155 . 

GGP 

GPKTC 

24.242 

26.728 

100.006 

GGP 

GPKTC 

1.439 

1.  001 

91.158 

GGP 

gpk  rc 

1.439 

1.  001 

91.158 

uGP 

GGP 

GGP 

GGP 

0 

0 

8 

188:888  n~.. 

GGP 

GGP 

GGP 

GGP 

8 

8 

188:888 

GGP 

GPKTC 

2.261 

25.079 

..  .  9to.732  . 

GGP 

GGP 

0 

40.000 

, 

■  ■  ■  •  r“;v-  ■ 

*•  r  - 

Tw  *  Ti  :  .  Vi... 

.  .  trJim. '■  .viv*.'  Zt 

• 

1 

.  :?r  ..w 

Table  8.  Student  t  Comparisons:  Convexifled  Primal  Strategies 


SAM°LE  STUOFNT  TEST 
IRELiTIV*  £RRO R  I.E-2) 


3ULTS 


problem 

NUMBER 


COOE  WITH 
BEST  AVB. 
TIME 

BRAOAU 
.  BRAOAU 
BRA  DAW 
BRAOHA 
BRAOAU 
...  0  RAO  AM 
■-  BRAOAU 
BRAOHA 
BRAOAU 


f BRAOHA 

BRAOHA 

BRAOHA 

BRAOAU 

BRAOAU 


MEAT  HESr 

ccoe 


BRAOHA 
BR  A  JHA 
BR AOHA 
BRAOAU 
BRAOHA 
BP.AJHA 
BRAOHA 
BRAOAU 
BRAOHA 
BRAOHA 
BRAOAU 
BRAOAU 
BRAOAU 
BRAOHA 
0R AOHA 


STUOENTS 
T  VALUE  - 


1.221 

14.44a . 

144.916 

17.9*0 

31S:M 

10.947 

15.287 

8..02|. 

0 

2.020 


i.:is3SrZi  :k«bekl* 

msjLJimmv 


•  n  4**-. 


37.888  77.026 

•  ^kooS  :7rrttfeHi«fc.Ta: 

14.972  100.000 

0  100.000 

i  nn-nnn 

T!t  RftrssariOWHrL 

14.927  100.000 

25.370  100.000 

0  100.000 

.  7.748  92.078 

- 1 . 636"r:rftf 


9,83$ 


S^!bST?Tvra0Sef!EE|fULTS 


PROBLEM 

jum&ZR 


CODE  WITH 

m 

1 BRAOAU 
BRAOAU 
BRAOHA 
BRAOAU 
RRAOAU 


BRAOHA 

BRAOAU 

BRAOAU 

BRAOAU 

BRAOHA 

BRAOAU 

BRAOAU 


NEXT  BEST 
CCC£ 


BRAOHA 

BRmOHA 

BRAOAU 

BRAOHA 

BRAOHA 

BRAOAU 

B»AOAU 

BRAOHA 

BRAOHA 

BRAOHA 

BRAOAU 

BRAOHA 

eRADHA 


STUDENTS 
T  UALUZ 


.142 

10.107, 

17.482 

0 

211.413 

1:$i 

14.131 

8*125 

0 

0 

0 

5.972 


0C6REE  OF  SIGNIFICANCE 
-  -FREEDOM  . .  ^  XE.UO. 

(,  +  ,  -'  •,{8  -».*■  »*»  >»  it  m tJ.  k  -.  Ad,. 


37. 747 

iiJlU 

0 

3.659 


14.2M 

24.678 

17.844 

a 

o 

0 

4.857 


11.246 

lao.oao., 

1 66.86 • 

100.000 

100.000 


100.000 

100.000 

JOB.  000—2^.  ,  , 
OO.OOO^' 
100.000 
99.829 

V.”  :  •  ■' 


T&&JlFzMinhf-llUL's 


PROBLEM 


code  uith 

m 

BRAOHA 

■i.  «*».;■ 

BRAOAU 

BRAOAU 

BRAOAU 

H8A0AU 

BRAOAU 

BRAOAU 

aaAOHA 

BRAOHA 


NEXT  BEST 
ZCOZ 


BRAOAU 
BRAOAU 
BRAOAU 
BRAOHA 
BR  AOHA 
BRAOHA 
BRAOHA 
BR  AOHA 
BRAOHA 
BRAOAU 
BRAOAU 


STUDENTS  DEGREE  OF  SIGNIFICANCE 


1.212 

17.68$ 

0 

208.235 
•  519 
4.715 
17.  141 
11.960 
0 
0 


36.990  76.665 

~  rnfczam  r,h 

3.566  i88i888 

•-  tfciJJ  v  - v 

25.777  100.000 

15.074  100.000 


rib1e  9.  Student  t  Comparison:  Harmonic  vs  Geometric  Mean 


*  nnirflfEJiLHI.-'-i 


F£  3ULT S 

) 


problen 

NUMBE* 


1 

2 
3 

5 

6 
7 
9 

11 

12 

13 

15 

16 
17 

19 

20 
21 
22 
23 
25 


C00£  with 
e«:s f  avb. 
time 

QPTTPO 

cpttpo 

o»p 

DAP 
0  AP 
QAP  . 
OPTtPO 
aPTTPO 
DAP 
DAP 
DAP 

OP  T  TP  0 
OPTTPD 
QPTTPD 
OPTTPO 
OPTTPD 
op  TTPO 
DAP 

OPTTPD 


NEXT 

Z  CZL 


BEST 


DAP 

OPTTPD 

OPTTPD 

CPTTPJ 

OPTTPD 

OPTTPj 

OPTTPD 

QA° 

OPTTPD 

OPTTPD 

OPTTPO 

CPTTPD 

DAP 

OPTTPD 

OPTTPD 

CAP 

OPTTPO 

OPTTPO 

OPTTPO 


T  UOr  NTS 
VALUE  . 

was.": 

.  *  i.  ■  '  - 

119.272 

19.000 

a 

26.559 

'  """  9»8iir 

87.  679 

5.000 

95.609 

19.000 

2.635 

0 

17.268 

56.839 

206.321 

106.628 

0 

.99  7 
0 
0 
0 
0 

•  178 

0 


SIGNIFICANCE 

..  Uvzl  ap.  QiFtj 


100.000 
10Q.QM 
188 .III 

100.000 
100.000 

--—4 

100.00 
100.00 
,vr.  IflO.OOfl 
180 .008 
0 

57.252 
.  100.000 
100.080 
100.000 
100.000 
.  i2.sa| 


B 


SAHPLJ  JTUD-;  NT  TEST 
t  R6L.il  .VE  iRROR  1.2 


FAULTS 

-  3 1 


OBLEM 

CODE  WITH 

NEXT  BEST 

STUDENTS 

DEGREE  OF 

SIGNIFICANCE 

NUMBER 

««  *Va- 

cccc 

r  VALUE 

.  FREEDOM  . 

•  -  W~i. 

LEVEL  OF  OIF  1 

-  1 

OPTTPO 

□  AP 

193.591 

19.000 

100.000 

•  S 

. OPTTPO 

OPTTPO 

OPTTPD 

OPTTPO 

0 

0 

i 

100.000  . 

•  100.38V 

,  5  ■ 

DAP 

CPTTPD 

OPTTPO 

307.815 

5. COO 

100.000 

6 

DAP 

229.  008 

19.000 

100.000 

1  . 

DAP 

.  OPTTPO 

17.498 

3.192 

.400.000  - 

■'  9 

OPTTPO 

OPTTPO 

0 

8.008 

(  «•  '  ■ 

11 

3P  T  TP  0 

CPTTPD 

0 

18.600 

0 

12 

□  AP 

CPTTPD 

5  56. 20  8 

9.000 

looiooe 

M 

,  DAP 

OPTTPO 

OPTTPD 

0A*> 

220.846 
53. 751 

ifcttt 

ttfcttl 

16 

OPTTPO 

CPTTPJ 

0 

0 

IOO.Oqo 

if 

OPTTPO 

DAP 

.  88  0 

1.000 

48.110 

if 

DP  TTPO 
OPTTPO 

OPTTPD 

OPTTPO 

a 

9 

*•••• 

•*}o0*G9$  ^  ! 

22 

OPTTPO 

OPTTPD 

0 

0 

100.000 

23 

0  Ap 

OPTTPD 

24. 750 

7.000 

100.000 

h  25 

--  DP  TTPO 

OPTTPD 

0 

.  4.000-  ... 

.  0.-.,, — 

Table  10.  Student  t  Comparison:  Transformed  Primal  Strategies 


C  cTy0rNT  TfcT  FAULTS 

(RLLiTlv*  *RRJR  £.£-‘•1 


PROBLEM 

NUMdEi 


1 


5 

6 
J 

■  9 

12 

13 

16 

17 

19 

23 


CODE  WITH 
dZST  At/d. 
tjmf 


OPT  TPO 
OPTTPO 
0«*TTP0 

DAP 

OPT  TPO 
DAP 

OPTTPO 

OPTTPD 

DAP 

DPT  TPO 
OPTTPD 
OP  T  TPO 
OPTTPD 


NEXT 

CCCZ 


CAP 

OPTTPD 

OPTTPO 

OPTTPD 

CPTTPO 

CPTTPD 

OPTTPD 

OPTTPO 

CPTTPO 

OPTTPD 

OPTTPD 

OPTTPO 

CPTTPO 


STUDENTS 
T  VALUE 


DEGREE  OF 
FREEDOM 


SIGNIFICANCE 
LEVEL  £F,.£l.Fl 


1.582  * 
0 
0 

335.393 

0 

9.d9g 

0 

126.665 

0 

0 

G 

0 


5.361 


82.939 


2.  000 

16.000 

18.000  ' 
7.000 
16.000 
0 
0 
0 


ll 0*000 


_  .  ,099 

99.999 

■loo I  la# 

0 

100.000 

ioo.ooi 

100.000 

100.000 


Table  10.  Student  t  Comparison:  Transformed  Primal  Strategies 


c  sample 

1RELA 

TE: 

live  Irror 

5  T  RESULTS 
I*E-4> 

PROBLEM 

C^OE  tel TH 

NEXT  dEST 

STUO'NTS 

OEGREE  OF 

SIGNIFICANCE 

NUMBER 

riZST  Aw  8* 

w  u  L. 

T  VALUE 

F9EEQGH 

LEVEL  OF  OIFi 

1 

TTMC 

884 OH 4 

e<uoAW 

1.212 

36.990 

i  . 

76.663 

1 

B8A0HA 

«PTCPD 

33.53d 

5.021.  - 

ttfcHI  ■ 

2 

0®  TCPO 

OPTTPO 

20.012 

25.892 

3 

0-">T  CP  0 

GGP 

3  8  •  63  5 

31. 394 

100.000 

5 

GGP 

OPTCPO 

ldS.539 

9.968 

100.000 

6 

GGP 

OPTCPO 

3  72.576 

...  4.296. - 

i  8  8  *  ■***-• — ■ ■** 

100.08V  - 

T 

G5P 

OPTCPO 

126.197 

37. 957 

9 

OPT  CP 3 

G  G  P 

.  692 

9.  761 

49.516 

9 

OPTCPO 

GpKTC 

4.559 

2.002 

99.148 

10 

GG? 

CPTCPR 

23C.654 

.  12.000 
16.991 

100. 000 

11 

GG® 

OPTCPO 

9.  306 

99.952 

12 

G3® 

OPTCPO 

26.184 

6.  029 

100. 000 

13 

□  A  P 

GGP 

162. 754 

19.000 

100.000 

19 

GGP 

CPTCPO 

■  41.471 

16.713 

Flfcmsr^vr. 

15 

8R&QAW 

BR  AOHA 

4.  71 S 

1 9. 636 

16 

d  9  4  JA  te 

tc  A  JflA 

1 7. 141 

25.  777 

100.000  . 

17 

89  A  OAM 

8P  AOHA 

11.460 

15.074 

100.000 

la 

GGP 

GGP 

C 

0 

100.000  . 

19 

GGP 

OPTCPO 

177.864 

5.000 

100.008  l«v 

20 

BRA  OH A 

d  .9  A  0  A  te 

0 

0 

100,000 

21 

BR  AOHA 

BP ACAU 

0 

0 

100.000 

23 

OPTCPO 

CPTCPR 

2.753 

1*028 

59.928 

25 

OPTCPO 

OPTCPR 

259.972 

3.000 

100#  OO^iGantl'i,  i)  ’ 

Table  11.  Student  t  Comparisons:  Overall 


Frequency 


Error  Level 

Ranking 

1st 

10"2 

2nd 

1st 

10"3 

2nd 

1st 

10"4 

2nd 

“ 

Series 

GGP 

13 

2 

12 

2 

10 

2 

GPKTC 

0 

0 

0 

0 

0 

1 

DAP 

1 

0 

0 

1 

1 

0 

BRADAW 

3 

5 

4 

3 

4 

2 

BRADHA 

4 

2 

3 

3 

3 

3 

OPTCPS 

0 

0 

0 

0 

0 

0 

OPTCPD 

4 

13 

5 

12 

5 

8 

OPTCPR 

0 

0 

0 

1 

0 

3 

OPTPD 

0 

0 

0 

0 

0 

0 

OPTTPD 

0 

1 

0 

1 

0 

1 

Table  1Z:  Test  Series  Ranking  Summary 
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APPENDIX  A 


Test  Problem  File:  Signomial  Form 

PROBLEM  MO  1  [22] ,  No.  1 1 
MINIMIZE  J 

GOOO  ■  -  (XI)  +  0.400000(X1**  O.S?)(X3**-O.B7) 

SUBJECTED  TO: 

C1(X)  »  0.058820CX3) (X4)  ♦  O.lOOOOO(Xl)  <=  1 

C2CX)  ■  4.0000CX2)(X4**-1.00)  +  2.0000(X2**-0.71)(X4**-1.00) 

♦  0.058820(X2**-1.30)(X3)  <■  1 


86 


PROBLEM  flO  S  t1*].  Section  11.2 

MINIMIZE  < 

CO(X)  ■  861000. (XI**  0.50) <X2)(X3**-0.67)  (X4**-0.50) 

♦  36900. (X3)  ♦  7.7E+008(X1**-1.00)(X2**  0.22) 
-  7.7E+008(X1**-1.00) 

SUBJECTED  TO: 

C1(X)  ■  (X2**-2.00)(X4)  ♦  (X2**-2.00)  <-  1 
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PROBLEM  MO  3  private  files 

MIMIMXZE  t 

GOOO  -  (XI**  2.00)  +  <X2**  2.00)  ♦  2.0000CX3**  2.00)  ♦  CX4**  2.00)  -  S.OOOO(Xl) 

-  5.0000CX2)  -  21.000000)  -  7.0000(X4) 

SUBJECTED  TO: 

C1(X)  *  0.125000(X1**  2.00)  +  0.125000CX2**  2.00) 

+  0.125000(X3**  2.00)  +  0. 125000(X4*«  2.00) 

♦  0.125000CX1)  -  0. 12S000CX2)  ♦  0.125000CX3)  ♦  0.125000CX4)  <-  1 

C2(X)  -  0.100000(X1**  2.00)  ♦  0.200000(X2«*  2.00) 

+  0. 100000CX3**  2.00)  +  0.200000(X4**  2.00) 

-  O.lOOOOO(Xl)  +  0. 100000CX4)  <-  1 

C3(X)  -  0.400000(X1»*  2.00)  +  0.200000CX2**  2.00) 

♦  0.200000CX3**  2.00)  +  0.400000CX1)  -  0.200000CX2) 

♦  0.200000CX4)  <*  1 

G4(X)  *  0.000100<X1*«-1.00)  <«  1 


PROBLEM  MO  S  [5]  ,  No. 2 


MINIMIZE  l 

GO<X)  -  5. 357800**  2.00)  ♦  0.835700<X1)(X5)  +  37.2392(X1) 

SUBJECTED  TO: 

C1(X)  ■  2.GE-005(X3)(X5)  -  S.7E-005(X2)(X5)  -  7.3E-005<X1XX4)  <-  1 

C2(X)  -  0.000853<X2XXS)  ♦  9.4E-005(X1XX4)  -  0.00033XX3XX5)  <«  1 

C3(X)  ■  1330.33(X2**-1.00XX5**-1.00)  -  0.420000(X1)(X5**-1.00) 

-  0.3058GO(X2**-1.00)(X3»*  2.00)CX5**-1.00)  <=  1 

C4CX)  -  2275. 13( X3**-l . 00) CX5**-1 . 00 )  -  0.2GS800(X1XX5**-1.00) 

-  0.405840(X4)(XS**-1.00)  <=»  1 

C5(X)  *  0.000242CX2) (X5)  +  0.000102CX1XX2)  +  7.4E-005CX3**  2.00)  <-  1 

G6(X)  ■  0. 000300  (X3XX5)  +  8.0E-005(X1 ) (X3)  ♦  0.000122CX3XX4)  <»  1 

C7(X)  «  78.0000(X1**-1.00)  <»  1 

C8CX)  ■  0.009304(X1 )  <=  1 

C9(X)  -  33.0000(X2**-I.00)  <=  1 

G10(X)  «  0.022222CX2)  <*  1 

Cll(X)  ■  27. 0000 ( X3**-l . 00 )  <=  1 

G12(X)  «  0.022222CX3)  <=  1 

C13(X)  »  27.0000(X4»*-1 .00)  <=  1 

C14(X)  ■  0. 022222 (X4)  <-  1 

G15(X)  ■  27.0000(X5**-1 .00)  <=  1 

G1G(X)  -  0. 022222 (X5)  <•  1 
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PROBLEM  HO  6  private  files 

MINIMIZE  i 

COCK)  -  0.003436<X1MX3**-I.OO)(X4)  ♦  0.001886(X1)(X3*»-1.00) 

-  0.001475<X2)(X3»*-1.00)  ♦  2345.00(X3**-X.OOHX7**-1.00> 

SUBJECTED  TO: 

OICX)  -  0.007353CX1XX4)  ♦  0.00476000)  ♦  0.0215001X1)  <»  1 

C8CX)  ■  0.t08600(Xl**-1.00)(X2)(X4**-1.00) 

♦  0.400000CX4**-1.00)  <«  1 

C3CX)  »  0.619600(X1*»-1 .00) (X2)  ♦  0.748000CX4)  <»  1 

C4CX)  *  (X5)(X6**~1.00)  ♦  1.3330<X6»*-1.00)  <■  1 

C5CX)  «  142.86CX1**  0.53)(X3i»-0.34)<X4**-0.5l>(X?**-i.?0>  <•  I 

C6CX)  »  0 . 002480 CX1»»  O.BO)(X3»*  1.40)(X4**-1. 10)(X5**-1.00HX7>  <*  1 

C7CX)  -  40.0000(X7**-1.00)  <«  I 

C8CX)  ■  0.125000CX6)  <■  1 

CS(X)  »  3.0000(X3**-1.00)  <»  1 

G10CX)  •  (XX**-1.00)CX3)(X4**  3.00)(XG)  <■  I 


PROBLEM  MO  7  [4],  Section  11.3 


MINIMIZE  t 

CO(X)  -  1.1047(X1**  2.00XX2)  ♦  0.G73500CX3XX4)  ♦  0.048110CX2XX3XX4) 

SUBJECTED  TO: 

C1(X)  «  12.0000<X2**-2.00XXG)  -  3.0000<X2**-2.00XX3*«  2.00) 

-  6.0000(X1)(X2**-2.00XX3)  -  3.0000<X1**  2.00XX2**-2.00)  <•  l 

G2CX)  «  0. 094280 (X3**~ 1 . 00 XX4»*-3. 00 )  ♦  0.027760(X3)  <-  1 

C3(X)  -  1.8E+007(X1«*-2.00XX2**-2.00XX5**-1.00) 

♦  2 . 5E+008 (XI **-2 . 00  X  X2**-l . 0 0 ) ( X5**- 1 . 0 0  X  XS**-1 . 00 ) 

♦  3.0E+006(X1**-2.00XXS**-1.00XXG**-1.00> 

♦  3.5E+009(Xl**-2. 00  XX2**-2.00  XX5**-1 . 00 )  (XG**-2. 00  XX7) 

+  2.5E+008(X1»*-2.00XX2**-1.00XX5**-1.00)CXB**-2.00XX7) 

♦  4.5E+OOG(X1**-2.00XX5**-1.00XX6»«-2.00XX7)  <=  1 

C4CX)  «  0. 250000 (X2**  2.00XX7**-1.00)  +  0.250000(X3**  2.00XX7**-1.00) 

♦  0.500000<X1XX3XX7**-1.00)  ♦  0.250000(X1**  2.00XX7**-1.00)  <•  1 

G5(X)  -  16.8000 ( X3**-2 . 00 ) ( X4**-l . 00 )  <=  1 

C6(X)  -  <X1XX4**-1.00)  <=  1 

C7(X)  *  0.125000<X1**-1.00)  <=  1 
C8(X)  =»  9. 0800 ( X3**-3 . 00  X X4 )  <=  1 


CStX)  *  7.4E-005(X5**  0.50)  <=  1 


PROBLEM  MO  8  [5] ,  No. 3 


MINIMIZE  : 

GO(X)  -  1.7150CX1)  ♦  0. 035000 ( XI HXS)  ♦  4.0565(X3)  *  10.0000CX2) 

♦  3000.00  -  0. 063000  (X3HX5) 

SUBJECTED  TO: 

C1(X)  ■  0. 005955 (XS**  2.00)  ♦  0.883929(X1**-1.00)(X3) 

-  0.1175631X6)  <=  1 

C2(X)  -  1.1088(X1)(X3**-1.00)  +  0.130353(X1)CX3**-1.00)CX6) 

-  0.006603(X1XX3**-1.00)(XS**  2.00)  <»  1 

G3(X)  ■  0. 000662 (X6»*  2.00)  +  0.017240CX5)  -  0.005660CX4) 

-  0.019121 (XG)  <=  1 

C4(X)  ■  56.8507(X5**-1.00)  +  1.0B70(X5**-1.00)CX6> 

♦  0.321750(X4)(X5**-1.00)  -  0.037620(XS«*-1.00)CX6**  2.00)  <«  1 

C5CX)  «  0.006198CX7)  +  2462.3XX2)  (X3**-1.QOXX4»*-UOO> 

-  25. 12561X2 ) (X3**-l. 00)  <=  1 

G6(X)  ■  161 . 19(X7**-1 . 00 )  +  5000 . 00 ( X2) ( X3**~ 1 . 00 ) ( X7**-l . 00 ) 

-  489550. (X2)(X3**-1.00)(X4**-1.00)(X7«*-1. 00)  <=  1 

C7(X)  ■  44 . 3333 ( X5**-l . 00 )  +  0. 330000 (X5**-l .00) <X7)  <-  1 

C8(X)  -  0.022556CX5)  -  0.007595(X7)  <*  1 

C9(X)  -  0.000610CX3)  -  O.OOOSOO(Xl)  <«  1 

CIO(X)  ■  0.819672<X1)(X3**-1.00)  +  0.819S72CX3«*-1.00)  <*  1 

Cll(X)  ■  24500. ( X2 ) (X3»*-l. 00 )CX4*»- 1.00) 

-  255.00CX2XX3**-1.00)  <*  1 

C121X)  «  0.0102041X4)  +  1.2E-005(X2**-1.00)(X3XX4)  <■  1 
G13(X)  ■  6.2E-005(X1)(X6)  ♦  6.2E-005(X1)  -  7.6E-005CX3)  <»  1 

G14(X)  ■  1.2200(X1*«-1.00)(X3)  +  (Xl**-1.00)  -  CX6)  <■  1 


GlS(X) 

G16(X) 

G17(X) 

G18(X) 

C19CX) 

CSOCX) 

G21(X) 

G22(X) 

GS3(X) 

G24(X) 

C25(X) 

G26(X) 

G27CX) 


O.OOOSOO(Xl)  <■  1 
<Xi<M»-l.OO>  <■  1 
0.008333CX2)  <-  1 
<X2**-1.00)  <■  1 
0. 000200 (X3)  <■  1 
(X3**-i.oo)  <-  ; 
0.010753CX4)  <-  1 
85.0000(X4**-1.00>  <-  1 
0.0105261X5)  <»  1 
90 . 0000 ( X5**-l . 00 )  <»  1 
0. 083333 (XG)  <-  1 
3.0000(XG**-1.00)  <«  1 
0.00G173CX7)  <=  1 


C28(X) 


145. 00 C  X7**-l . 00 )  <-  1 


PROBLEM  MO  9  t53 ,  No. *4 


MINIMIZE  : 

CO(X)  ■  O.4O0OOO(X1<h»  0.67)(X7**-0.G7)  ♦  0.400000<X2**  0.67)(X8**-0.B?) 

♦  10.0000  -  (XI)  -  (X2) 

SUBJECTED  TOt 

GKX)  «  0.0S8800(XS) (X7)  +  O.lOOOOO(Xl)  <=  l 

C2(X)  ■  0. 058800  (XGKX8)  ♦  O.lOOOOO(Xl)  +  0.100000CX2)  <*  1 

C3(X)  *  4.0000CX3) (X5**~l.OO)  +  2.0000(X3**-0.71)(X5**-1.00> 

+  0 . 058800 ( X3**-l .  30 )  ( X7 )  <=  1 

C4(X)  «  4. 0000 (X4)( X6**-l . 00 )  +  2.0000(X4**-0.71)(XS**-1.00) 

♦  0.058800(X4**-1.30)(X8)  <*  1 

C5CX)  *  O.lOOOOO(Xl)  <»  1 
GG(X)  «  0.100000(X1*«-1.00)  <*  1 
G7(X)  «  0.100000<X2)  <-  1 
C8(X)  ■  0.100000(X2**-1.00)  <«  1 
C9(X)  ■  0.100000<X3)  <«  1 
CIO(X)  *  0. 1 00000 (X3**- 1.00)  <*  1 
Cll(X)  «  0. 100000CX4)  <«•  1 

G12(X)  •  0. 100000 (X4**-l .00)  <=  1 
G13(X)  ■  O.IOOOOO(XS)  <■  1 
G14CX)  «  0,100000(X5**»-1.00)  <■  1 
C15(X)  -  O.IOOOOO(XS)  <•  1 
G1G(X)  «  0.100000<X6*«-1.00)  <«  1 
C17(X)  ■  0. 100000 (XT’)  <•  1 


G18CX)  ■  0.100000(X7<m»-1.00)  <■  1 
G1S(X)  ■  0.100000CX8)  <■  1 

C20(X)  »  0.100000(X8*mi-1.00)  <»  1 
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PROBLEM  MO  10  [5] ,  No.  5 
MINIMIZE  t 

COCX)  -  CXI)  +  CXS)  +  CX3) 

SUBJECTED  TO: 

Cl(X)  ■  833.33<X1»*-1.00)(X4)(XB**-1.00) 

♦  100.0000(XS»*-1.00)  -  83333. (X1**-1.00)(X6**-1. 00)  <=  1 

G3CX)  «  12S0.00CX2**-1.00)<X5)(X7**-1.00) 

♦  (X4)(X7*m*-1.00)  -  1250.00<X2**-1.00)(X4)(X7**-1.00)  <=  1 

C3CX)  «  1.2E+006(X3**-1.00)(X8**-1.Q0)  +  CXS) (X8*«-1.00>  -  2500.00(X3**-1.00)(X5)CX8«*-1.00>  <»  1 

G4CX)  *  0.002500CX4)  +  0.002500CX6)  <=  1 

C5CX)  »  0.002S00CX5)  ♦  0.00H500CX7)  -  0.002500CX4)  <=  1 

CSCX)  «  0.010000CX8)  -  0.010000CXS)  <=  1 

C7CX)  *  0.000100CX1 )  <«=  1 

G8CX)  »  100.0000CXl**-l,00)  <=  1 

G9CX)  ■  0.000100CX2)  <»  1 

G10CX)  »  1 000 . 00 (X2*»-l . 00 )  <=  1 

GllCX)  ■  0.000100CX3)  1 

G12CX)  *  1000.00(X3**-1.00)  <=  1 

G13CX)  -  0.001000CX4)  <=  1 

G14CX)  *  1 0. 0000 (X4**~ 1.00)  <=  1 

G15CX)  *  0.001000CX5)  <=  1 

C16CX)  ■  10.0000(X5**-1.00)  <=  1 

G17CX)  »  0.001000CXG)  <-  1 


G18CX)  -  10.0000(XS**-1.00)  <=  1 


G19(X)  ■  0.001000CX7)  <»  1 
G20<X)  ■  1 0. 0000 (X7 **-1.00)  <=  1 
caicx)  »  o.ooiooocxs)  <=  1 
G22CX)  -  10. 0000 ( X8**- 1.00)  <=  1 
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! 

i 

PROBLEM  NO  II  private  files 

MINIMIZE  ! 

co(X)  »  -  oemxsj  -  (X4)cxs>  +  (xs>  +  (xsx 

SUBJECTED  TO: 

C1(X)  »  50.0000CXl**-l.00>  -  <X1**-1.00)(X2)  <=  1 

C2(X)  *»  1.4609(X5**~1.00)  +  0. 1S18E0CX1 ) (X5**-1.00) 

+  0.001450(X1**  a.00HX5**-1.00)  <=  1 

C3(X)  «  O.B00800tX6**-l,00)  +  n.2O31O0(X2)CXS**-i.OO> 

+  0.000SIBCX2**  a.O0HXS**-1.0O)  <=  1 

G4(X)  *  0. 10000QCX3XX7)  +  0. 100000<X4)(X8)  <=  1 

GS(X)  =  1.5742(X7**-1.00)  +  0.XS31OO(X1)<X7**-1.OO) 

+  O.OOI 358CX1**  2.00)(X7**-1.QO)  <=  1 

GG(X)  a  0.7ase00(X8**-1.00)  +  0.225GOO(X2)(XS**~1.00) 

+  0.000778(xa**  a.00)CX8**-I,00)  <=  1 

G7(X)  a  18.0000<X1**-1.00)  <=  1 

G8(X)  »  0.033333(X1)  <=  1 

G9(X)  a  14.0000CX2**-1.00)  <=  1 

CIO(X)  *  0.040000(X2)  <=  1 

Gll(X)  *  <X3)  <=  X 

Gia(X)  »  CX4)  <=  X 
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PROBLEM  NO  IS  private  files 

MINIMIZE  s 

GO(X)  «  0.005G50<X1)(X4**-1.00)  +  0.002189CX2**  2.00HX4**-1.00) 

+  0.032840(X3)(X4**-1.00)  +  2345.00(X4**-1.00)(X5**-1.00) 

SUBJECTED  TO: 

G1(X)  *  0. 747940 (Xl»*-1. 00 )( XG ) (X7)  -  0.380400(X1**-1.00) (X2) 

-  0. 299180 (Xl»*-1. 00) (X3)  <=  1 

G2(X)  a  0.031330CX1)  +  0.030000(X2)  +  0.024400CX3)  <=  1 

G3(X)  -  (X8)(X9**-1.00)  +  1.3330<X9**-1.00)  <=  1 

G41X)  *  (X1)(X7**-1.00)  +  (X2)(X7**-1.00)  +  (X3)(X7**-1.00)  <=  1 

U5(X)  *  0.007000CX4**  0.34HX5**  1.70)(X8**  0.5l)(X7**-0.53)  <=  1 

G6(X)  *  0.002480<X4**  1.40)CX5)(XG**-1.10)(X7**  0.80)(X8**-1.00)  «=  1 

G7CX)  *  40.0000(X5**-1.00)  <=  1 

G8(X)  =  0. 125000CX9)  <=  1 

G9(X)  *  3. 0000 (X4**-l . 00 )  <=  1 

GIO(X)  *  (X4)(XG**  3.00)(X7**-1.00)tX9)  <=  1 

Gll(X)  -  0.050000(X3**-1.00)(X7)  <=  1 


PROBLEM  NO  13  [M  ,  Section. 10.1 


MINIMIZE  s 

CO<X)  a  5.8850(X1HX4)(X5**-1.00)  +  5.88S0(X3)(X4)(X5**-1.0O) 
SUBJECTED  TO: 

G1(X)  *  <X3**-2.00)(XG**  2.00)  +  <X2**  2.00)(X3**-2.00)  <=  1 

G2(X)  =  8.9400(X1)(X2**-1.00)(X4**-1.00)(X7**-1.00> 

+  8.9400(X2»*-1.00)(X4**-1.00XX7**-1.00)(X8>  <=  1 

G3CX)  »  8.9400(XlHX9**-2.00)  +  8.9400CX8)(X9**-2.00)  <=  1 

G4(X)  =  0 . 015600 ( XI ) C X4**-l . 00 )  +  0.150000(X4**-1.00)  <=  1 

G5(X)  a  O.O15GO0CX3) (X4**-l . 00 )  +  0.1S0000(X4**-1.00)  <a  1 

G6(X)  =  CX1**-1.00)(X5)  -  <X1**-1.00)(X6)  <=  1 

G7(X)  -  2.5000CX1*«-1.00)(X7)  -  0.41GS67(X1**-1.00)(X3)  <a  1 

G8(X)  =  (X2**-2.00XX3**  2.00)  -  (X2**-2.00XX8**  2.00)  <=  1 

G9(X)  »  4.4000(X2**-2.00)(X4**-1.00)(X7**-1.00XX9**  2.G7)  <=  1 

G10(X)  a  1 . 0500 ( X4**-l . 00 )  <=  1 

GlltX)  =  (X2XX3**-1.00)  <=  1 


PROBLEM  NO  14  t22l  .  No. 12 


MINIMIZE  » 

CO(X)  -  2.848S(X1)  -  22.4990(X1)(X2)  +  2.8952(X1XX3) 

♦  0.3057001X1 ) (X4)  -  4.4318(X1)(X5>  +  0. 140000(X1)(X5**  2.00) 

+  3.5974(X1)(XB)  +  0.050000(X1)(X7) 

SUBJECTED  TO: 

C1(X)  »  100.0000(X3) (X9**-1.00)  -  100.0000(X3)(X8**  0.01)(X9**-1.01) 

♦  (X8)(X9**-1.00)  <=  1 

G2CX)  =  0.474400CX1) CX4**-1.00) (X8**-1.G0) 

+  0.875G40(X1**-1.00)(X4)(X6)(X8**-1.00) 

+  0.012152(X1)(X8**-1.00)  +  0.139100(X1)(XG)(X8**-1.00) 

♦  0.397900 (XI )CXG**  2.00) (X8**-l .00) 

-  5.7222CX6)  <=  1 

C3(X)  -  10.4351(X1**-1.00)(X4)(X5**-1.00)(X9**-1.00> 

-  72.547G(X5**-1.00)  +  5.G303CX3) (X5**-l .00) 

+  0 . 127900 ( X4 ) ( X5**~ 1.00)  -  1.8459(X6)  -  133.91(X5**-1 .00) (X6) 

♦  10.3930(X3)(X5**-1.00)(XG)  +  0.23G200(X4)(X5**-l.00)(X6) 

♦  19.2G11(X1**-1.00)(X4)(X5**-1.00XX6)(X9**-1.00)  <=  1 

G4(X)  =  0.003309CX1)  -  0.00G910(X1)(X3)  -  0.00048G(X1)(X4) 

♦  0. 010090 (XI ) (X5)  -  t.3E-00G(Xl**  3.00)  -  1.5E-005(X1**  3.00HX6) 

-  4.2E-005(X1**  3.00)(XS**  2.00)(X8»*-1.00) 

-  0 . 000253 ( XI ) ( X5**  2.00)  <=  1 

GS(X)  «  21.3351 (X4**-l. 00)  -  1.8458(XG)  <=  1 

G6(X)  -  0.002017(X1 )  +  0.004878(X1)(X2)  ♦  0. 005735(X1 ) (X5) 

-  0.000744(X1)(X3)  -  G.3E-005(X1 ) (X4)  -  1 .3E-005(X1 ) (X7 )  <=  1 

G7(X)  »  0.001817(X1 )  +  0.0H287(X1)(X2)  +  0.010795(X1)(X5) 

1.3E-005(X1)(X7)  -  0. 003304(X1 )  (X3)  -  0. 000471  <  XI XX4) 

-  0.0003G3(X1)(X5«*  2.00)  <=  1 

G8(X)  =  0.025B16(X1**  2.00) (X7**-1.00)  +  0.293164(X1**  2.00XXSXX7*«-1.00> 


♦  0.838770<X1**  a.OOXXB**  2.00)(X7*«-1.00)  <»  1 

C9(X)  ■  -  4.4400<XS«*-1.00)  +.  41.0400(X2HX5**-1.00) 

♦  5.6300(X3)(X5*«-1.00)  +  0. 122800CX4) (X5**-1.00)  <■  1 

C10(X)  a  0. 400000 (X6**- 1.00)  <=  1 
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PROBLEM  MO  IS  [22]  ,  No.  15 
MINIMIZE  : 

GO(X)  -  0.0500001X1)  +  0.0500001X2)  +  0.0500001X3)  +  (X 9) 

SUBJECTED  TO: 

C1CX)  *  1X7**-1. 00)1X10)  -  0.5000001X1)1X4)1X7**-1.00)  <=  1 

C2(X)  »  1X7) 1X8**- 1 . 00 )  -  0.5000001X2) (XS) 1X8**“1 . 00)  <=  1 
G3(X)  *  1X8)IX9**-1.00)  -  0.5000001X3)1X6)1X9**-1.00)  <»  1 
C4CX)  -  0.5000001X9) 1X10**-1. 00)  0.2500001X10**-1.00)  <«  1 

C5(X)  -  0.7968101X4) 1X7**-1. 00)  <=  1 
G61X)  -  0.7968101X5)  1X8**- 1 .  00 )  <=»  1 
G71X)  «  0.7968101X6) 1X9»*-1.00)  <=  1 


PROBLEM  NO  16  [22] ,  No.  I1* 


«NIHI2E  * 

CO(X)  «  <XS)  +  0.40Q000(X4**  0.67)  ♦  0.400000(X9**  0.67) 
SUBJECTED  TO: 

G1(X)  «  10.0000(X3**-1.00)  -  (X1)(X3**-1.00)  1 

G2(X)  «  (X1)(X8**-1.00)  -  <X6XX8**-1.00>  <=  1 

C3CX)  ■  (Xl**-l.OOXX2**-1.5OXX3XX4**-1.0OXX5**-L.OO) 

♦  5.0000<X1«*-1.00XX2**-1.00XX3XX5**  1.80)  <-  1 

C4(X)  ■  0.05000000)  +  0.050000(X2)  <=  1 

G5(X)  »  <X6»*-1.00XX?**-1.50XX8XX3**-1.00XX10**-1.00> 

♦  S.0000(X6**-1.00XX7**-1.00XX8XX10**  1.20)  <®  1 

G6(X)  -  (X2**-1.00XX7)  ♦  (X2**-1.00)(X8)  <=  1 


G7<X) 


10.0000CX10)  <=  1 


PROBLEH  nO  17  [22],  No.  16  . 

MINimZE  I 

CO(X)  ■  O.OSOOOO(Xl)  +  0.050000(X2)  +  0.050000(X3>  +  <X3) 
SUBJECTED  TO! 

C1(X)  ■  O.SOOOOO(X9)(X10**-1.00)  ♦  0.2SOOOO(XlO**-1.00)  <=  1 

C2(X)  ■  (X7**-1.00HX10)  -  0.500000CX1 ) CX4)CX7**-1 . 00)  <=  1 

C3(X)  -  <X7)(X8**-1.00)  -  0.500000(X2KXS)(X8**-1.00)  <-  1 

G4(X)  *  (X8) (X9**~l *00)  -  0.500000(X3)(XS)(X9**~1.00)  <=  1 

C5(X)  «  0.700329(X4)(X7**-1.00)  +  0.307795<X7)  <*  1 

G6CX)  ■  0. 700329 (XS)(X8**-1. 00)  +  0.307795CX8)  <=  1 

C7(X)  ■  0.700329(XG)(X9**-1.00)  +  0.307795 CX9)  <=  1 


PROBLEM  MO  18  [22]  ,  NO.  21  . 


MINIMIZE  t 

CO(X)  -  -  0.0S3000(X4)(X7)  +  5.0400(X1>  ♦  0.03SOOOCX2)  ♦  10.0000(X3> 

♦  3.3500CX5) 

SUBJECTED  TO: 

CI(X)  •  0.8928G0(X1**-1.00HX4)  -  0.H75S0(X8)  +  0.005955(X8**  2.00)  <=»  l 

G21X)  =»  0.017410(X7)  -  0.019130CX8)  +  O.OOOS62CX8**  2.00) 

-  0. 005560 (X6)  <=  1 

G31X)  -  35.8200 1 X9**- 1.00)  -  0.222100(X9**-i.00) (X10)  <»  1 
G4(X)  -  1.2200(X4)(X5**-1.00)  -  (X1)(X5**-1.00)  <«=  1 

C5(X)  ■  (X1)(X2**-1.00)(X8)  -  1.2300(X2**~1.00)(X4) 

♦  <X1)(X2**-1.00)  <-  1 

C6(X)  «  0.330000<X7**-1.00)(X10)  ♦  44.3330(X7**-1.00>  <*  t 

G7CX)  ■  1.0E-005(X3**-1.00)fX4)CXG)(X9)  +  0.010202(XS)  <»  1 

C8CX)  -  O.OOOSOO(Xl)  <»  1 

GS(X)  ■  5.2E-005(X2)  <»  1 

C10(X)  »  0.008333CX3)  <*  1 

Glt(X)  •  0. 000200 (X4)  <=  1 

G12(X)  •  0.000500CX5)  <»  1 

G13(X)  «  0.010753(X6)  <=  1 

G14(X)  ■  85. 0000 (XB**-1 . 00 )  <*  1 

G15(X)  ■  0.01052G(X7)  <»  1 

G1SCX)  «  90 . 0000 ( X7**- 1.00)  <*  1 

G17(X)  *  0.083333(X8)  <=  1 
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C1S<X)  • 
C1900  ■ 
G20(X)  - 
G21(X)  - 
G22CX)  - 


3.0000(X8**-t.00>  <»  1 
0.25000000)  <*  1 
1.2000<X9*<*-1.00)  <*  1 
0.006173(X10)  <«  1 
145.00(X10«*-1.00>  <■  1 


I , 
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niOBLEH  MO  19  122]  ,  No.  24 

MINIMIZE  t 

CO(X)  -  1.2626(X8)  ♦  1.862600)  ♦  1.2686(X10)  -  1.2311(X1)CX8) 

-  1.831100)00)  -  1.231KX3XX10) 

SUBJECTED  TO: 

G1(X)  •  0.034745(X1)(X4**-1.00)  +  0.975000CX1)  -  0. 009800(X1**  2.00XX4**-1.00)  <*  1 

G2(X)  •  0.034745(X2) (XS**-1.00)  ♦  0.97500000)  -  0. 009800CX2**  8.00)(X5**-1.00)  <=  1 

G3(X)  ■  0.034745(X3) (X6**-1.00)  +  0.975000CX3)  -  0.00980000**  2.00)CX6**-1.00)  <=  1 

G4(X)  -  (X1)(X5**-1.00)CX7**-1.00)(X8)  +  (X4) (X5**~1.00)  -  1. 1000(X4)CX5**-1.00)(X7**-1.00)(X8) 

C5(X)  «  0. 002000 (X2)(X9)  +  0.002000(X5)(XB)  *  (X5)  ♦  (X6)  -  0. 002000(X1 ) (X8) 

-  0. 002100 ( X6) (X3)  <*  1 

C6CX)  «  <X8**-1.00)(X3)(X9**-1.00)(X10)  +  00**-1.00)(X6)  +  500.0000**- 1.00) 

-  1. 1000CX9**-1 .00) (X10)  -  510.00(X2**-1.00) (X6)(X9**-1 .00)  <=  1 

C7(X)  *  0 . 9000 00 ( X2»*- 1.00)  +  0.002000CX10)  -  0.002100(X2**-!.00)(X3)CX10)  <=  1 

G8CX)  •  0. 002000 CX7)  -  0.002100(X8)  <=  1 

G9(X)  *  (X2)(X3**-1.00)  <=  1 

G10(X)  »  (X1)CX2**-1.00)  <=  1 

Cll(X)  *  (XI)  <=*  1 

C12(X)  -  0.100000(X1**-1.00)  <=  1 

G13CX)  •  (X2)  <*  1 

C14CX)  -  0. 100000 (X2**-l. 00)  <■  1 

C15(X)  ■  (X3)  <*  1 

C16(X)  -  0 . 900000 ( X3**-l . 00 )  <=  1 

G17(X)  =»  10.0000(X4)  <*  1 


G18(X) 


0. 100000 (X5**-l. 00)  <-  1 


G13(X) 

■ 

l.im(XG)  <»  i 

G20CX) 

■ 

0. 100000 (XS**-1. 00)  < 

GSl(X) 

• 

500.00(X9**-1.00)  <» 

GS2CX) 

- 

0. 002000CX10)  <=  1 

G23(X) 

m 

0.100000(X10**-1.00) 
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PROBLEM  MO  20  [22]  ,  No  .  1  7 
MINIMIZE  : 

GO(X)  ■  (X3**-1.00) 

SUBJECTED  TOS 

G1(X)  »  0. 999000 (X4**-l. 00)  -  100. 10CX7HX10)  <*  1 

G2(X)  -  CX10)(X11**-1.00)  -  10.0200CX8)  <=  1 

G3(X)  »  (XS**-1.00)  -  10.2000(X1**-1.00)(X8)(X11)  <=  1 

G4(X)  »  10.0000CX11)  -  10.0200CX9)  <=  1 

CS(X)  ■  (X6**-1.00)  -  1.2000<X2**-1.00)(X9)  <=  1 

GG(X)  a  0.098000CX10)  0.980000(X7)(X10)  <=  1 

G7(X)  -  9.8000(X1)(X4)  +  9.9000CX1 ) (X4) (X7**  2.00)  <=  1 

G8(X)  a  0.980000(X1**-1.00)(X2)CX5)  +  0. 990000(X1**-1 .00) (X2) CX5) CX8**  2.00)  <=  1 
G9CX)  «  0. 970000 (X2**-l. 00 )(X3)(X6)  +  0.980000(X2**-1. 00) (X3) (XB) CX9**  2.00)  <=  1 


kL 


no 


PROBLEM  MO  21  [22]  ,  No.  )8 

MINIMIZE  : 

GO(X)  -  (X9**-1.00) 

SUBJECTED  TO: 

C1(X)  *  -  (X2)(X4**-1.00)(X11)  +  (X4**-1.Q0)(X5)  +  0.010000(X4**-1.00)(X5)(X11)(X13**-1.00) 

♦  0. 010000 (X4**-l, 00 )(X5) (XI 1)  <=  1 

C2(X)  -  -  0.010000CX5) (X7**-l .OOMXll)  f  (X?**-1.00)(X8)  <=  1 

G3(X)  *  -  2100.00(X3)(X5**-1.00)  +  2S.2000(X5**-1.00)CXS)  <=  1 

G4(X)  *  -  21.1300(XG)(X8**-1.00)  +  (X8**-1.00XX9)  <=  1 

GS(X)  ■  (XI)  +  (X1HX10)  +  (XI ) (X10)  (X12)  <=  1 

GS(X)  *  (X1**~1.00)(X4)(X10**-1.00)  +  0. 009000(X1**-1. 00) (X4) <X12**-1 . 00 ) 

+  0. 009000 (Xl**-1. 00 ) (X4)  <=  1 

G7(X)  »  0. 990000 ( XI**- 1 . 00) (X2)  +  (Xl**-i . 00) (X2) (XI 1 )  +  (XI**- 1 . 00 ) (X2) (XI 1 ) (X13)  <=  1 

G8CX)  =  94.0000(X4**-1 . 00) (X7) (X10**-l .00)  <=  1 


G9(X)  ■*  9301.00(X2**-1.00)(X3)  <=  1 


m 


PROBLEM  MO  22  [22]  ,  No.  20  . 

MINIMIZE  : 

GO(X)  *  -  O,2SOO0O(X1)(X6»*-I.OO)  +  0.S73200CX2) (XS**-1.00) 

♦  1.1200(X3)(XS»*-I.00)  -  31047. <XS**-I. 00) 

♦  0.007400(X5KXS**-1.00) 

SUBJECTED  TO: 

C1CX)  ■  0.G39926(X4**-0.25MX8)(X10**~1.0D) 

-  0. 156564 (X4**  0.42) (X9«*-1.00) (Xll ) 

-  0.100000(X10)(X13**-1.00)  <=  1 

G2CX)  *  ( XI ) (X4**-l .  00  )  ( X7»*-l .  00  )  ( X8**-i .  00 )  ( X9**-l . 00 ) 

-  0.312540CX4**  0.25KX10)CXi3*«-1.00)  <=  l 

C3(X)  *  (Xll*#-1.00HX13)  +  1.250KX4**  1.25HX7)(X9KX10UX11**-1.Q0)  f 

-  0.244660CX4**  1.67HX7XX10)  <=  1 

C4CXJ  «  (X5**-i.00)(X12)  +  0. 733980 (X4**  I.G7KX5**-I.00)CX7)(X10)CXn) 

+  <X5**-1.00HXU)  -  (X5**~I . 00) (X13)  <«  1 

G5(X)  a  3809.97(X4**-1.25)(X7**-1.00)(X9**-1.00)CX10*#-1.00) 

+  0 . 1 9S7 06 ( X4**  0.42)(X9**~1.00)(XU)  <=»  l 

GS(X)  *  (X10)(X12**-1.00)  +  0.2 44660<X4**  O.57XXS»*-1.0O)CX;tO>CXIl)(Xl2**-l.OO) 

♦  0. 156270 CX4**  0.25) (X10**  2.00>(X12*»-:.00)CX13**-I.00> 

+  (X9)(X12»*-1.O0)  +  11.0000<X12**-1 .00) (XI 3)  +  1.5S28'X4**  0 , 25HX1C > (X12**-1.00)  <»  1 
G7(X)  *  0 . 733980 ( X3»*- 1 . 00 ) ( X4*»  0,67)(X7)(X10)CXI1)  <=  1 

G8(X)  ■  0.312540(X2**-1.00)(X4**  1.25)(X7)(X9)(X10)(X12)(X13**-1.00)  <-  1 
G9(X)  «  0.020000(X5**  2.00)(XS**-1.00HX7)  <=  1 
G10(X)  -  0.007720CX4)  <*  1 


Gll(X)  *  G. 1800(X4**-1 . 00)  <=  1 
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PROBLEM  MO  23  [22]  ,  No.  19 

MINIMIZE  : 

GO(X)  *  2.0425CX1**  0.78)  +  52.2500CX2)  ♦  192.85CX2**  0.90) 

♦  5.2500(X2**  3.00)  +  S1.4650(X6**  0.47) 

♦  0.017480CX3**  1 . 33 ) ( X4»*-0 . 80 )  +  100.70(X4**  0.55) 

+  3.7E-010CX3**  2.85) (X4**-1.70)  +  0.009450CX5)  +  1.1E-010CX4**-1.8Q)(X5*»  2.80) 

♦  11S.00CX6)  -  205. 00(XS) (X7)  -  278.00(X2**  3.00HX7) 

SUBJECTED  TO: 

G1(X)  »  129.40(X2**-3.00)  +  105.00CXG**-1.00)  <=  1 

C2(X)  =  103000. (X2**  3.00)(X3**-1.00)(X7)(X8**-1.00) 

♦  1.2E+OOG(X3**-1.00)(X8**-1.00)  <=  1 

G3(X)  *  4.G800(X1**-1.00)(X2**  3.00)  +  G1.3000(X1**-1.00)CX2**  2.00) 

♦  1G0.50(X1**-1.00)(X2)  <=  1 

G4CX)  »  1.7900CX7)  +  3.0200CX2**  3.00)(XG**-1.00)(X7) 

+  35.7000(XG**-1.00)  <=  1 

G5(X)  =  0 . 001220 ( X3 ) ( X4**-0 . 20 ) C  X5**-0 . 80 ) (X8 ) 

+  0.001G70(X3**  0 . 40 ) ( X4**-0 . 43 ) ( X8 ) 

♦  3.6E-005(X3)(X4**-1.00)(X8)  +  0.002000(X3)(X5**-1.00)(X8) 

♦  0. OC4000CX8)  <=  1 


PROBLEM  NO  24  [5]  ,  No.  6 


MINIMIZE  : 

GO(X)  -  (Xll)  ♦  (X12)  ♦  (X13) 

SUBJECTED  TO: 

G1(X)  »  1.2S2S(X8)(XU**-1.00)  -  1.2311(X1)(X8)(X11**-1.00)  <=  1 

G2(X)  »  1.2S2S(X9)(X12**-1.00)  -  1.2311(X2)(X9)(X12**-1.00)  <=  1 

G3CX)  -  I.2e26(X10)(X13**-l.00)  -  1.2311(X3)(X10XX13**-1.00)  <=  1 

G4(X)  =  0. 034750 (X2)(X5»*-1. 00)  +  0.975000CX2)  -  0. 009800(X2**  2.00)(X5**-1.00)  <»  1 

C5CX)  =  0 . 034750 ( X3 ) ( X6**- 1 . 0  0 )  +  0.975000(X3)  -  0.009750CX3**  2.00)(X6**-1.00)  <=_ 1 

G6(X)  »»  (X1)(X5**-1.00)(X7**-1.00)(X8)  ♦  (X4) (X5**-l .00)  -  1. 1000CX4)(X5**-1.00)(X7**-1.00)(X8)  <=  1 

C7(X)  *  0. 002000 ( X2) (X9)  +  0.002000(X5)(X8)  +  (XB)  +  (X5)  -  0.002110CX1)(X8) 

-  0.002000(X6) (X9)  <=  1 

G8(X)  -  (X2**-l .00) (X3) (X9»*-l . 00) (XIO)  +  (X2«*-1.00)(XB)  +  500.00(X9**-1.00) 

-  (X9**-1.00)(X10)  -  501.00(X2**-1.00HXG)CX9«#-1.00)  <*  1 

G9(X)  =  0.900000(X2**-1.00)  +  0.002000(X10)  -  0.002200(X2**-1.00)CX3)(X10)  <*  1 
G10(X)  «  0.002000CX7)  -  0.002100(X8)  <=  1 

Gll(X)  =  0.034 750 (XI ) (X4»*-l .00)  +  0.975000CX1)  -  0. 009800CX1**  2.00)(X4**-1.00)  <*  1 

G12CX)  «  0. 980000 (X2) (X3**-l . 00 )  <=  1 

G13CX)  «•  (XI ) (X2**-1 . 00)  <=  I 

G14(X)  »  0.100000(X1**-1.00)  <=  1 

G15(X)  -  (XI)  <=  i 

G1B(X)  *  0. 100000(X2**-1.00)  <=  I 

G17(X)  *  (X2)  <*  1 

G18(X)  *  0. 900000 (X3**-I .00)  <=  1 


G19CX) 

* 

<X3)  <»  1 

G20CX) 

a 

0. OOOIOO (X4**-l. 00)  .<=  1 

G21(X) 

a 

10.0000CX4)  <=  1 

G22CX) 

a 

0 . 100000 ( X5**- 1.00)  <=  1 

G23(X) 

s 

1.111KX5)  <=  1 

G24(X) 

» 

0.100000(X6**-1.00)  <*  1 

G25(X) 

a 

1.111KX6)  <=  1 

G2GCX) 

- 

0. 100000 (X7**-l. 00)  <=  1 

G27(X) 

a 

0.001000CX7)  <=  1 

G28CX) 

* 

0.100000(X8**-1.00)  <=  1 

C29CX) 

- 

0.001000CX8)  <=  1 

G30(X) 

a 

500.00(X9**-1.00)  <»  1 

G31(X) 

a 

0.001000CX9)  <=  1 

G32(X) 

a 

0.100000(X10**-1.00)  <=  1 

G33(X) 

a 

0.002000(X10)  <=  1 

G34CX) 

a 

(xn**-i.oo)  <=  i 

G35CX) 

a 

0.006667CX11)  <*  1 

G36CX) 

a 

0.000100<X12**~1.00)  <=  1 

G37(X) 

a 

0. 0066G7(X12)  <=  1 

G38(X) 

a 

0.  OOOIOO (X13**-l. 00)  <=  1 

G39CX) 

a 

0.00GGB7(X13)  <=  1 
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PROBLEM  NO  SS  [23]  ,  No.  11  ‘ 

MINIMIZE  : 

GO<X)  «  (X14)  +  (X13)  ♦  (X12)  ♦  (Xll)  +  (X10) 

SUBJECTED  TO: 

G1(X)  *  0.002000(X9)  +  0.002000(X8)  <=  1 

G2<X)  »  0.001000CX7)  +  O.OOIOOO(XS)  -  0.001000CX9)  <=  1 

C3CX)  »  0.002000CX5)  ♦  0.002000CX4)  -  0.002000CX7)  <=  1 

G4(X)  -  0.001400CX3)  +  0.001400CX2)  -  0.001400(X5)  <=  1 

GS(X)  -  0.003000(X1)  -  0.003000CX3)  <=  1 

G6(X)  =  0.01000CKX9)  +  0.001750(X14)  -  1 .2E-005CX8) CX14)  <=  1 

G7CX)  -  (X7)tX3**-1.00)  +  0.001150(X13)  -  0.000800CXS>(X3**-1.00)(X13)  <=  1 

G8(X)  -  (X5) (X7**-l .00)  ♦  0.000364CX12)  -  0.000400CX4)CX7**-1.00HX12)  <=  1 

G9(X)  -  (X3)(X5**-1.00)  +  0.000332(X11)  -  0.000200(X2)(X5**-1.00)(X11)  <=  1 

G10CX)  -  700.00(X3**-1.00)  +  0.000103(X10)  -  0.000100(X1HX3**-1.00HX10)  <*  1 
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PROBLEM  NO  26  [S3  No.  7  • 

MINIMIZE  > 

COCX)  »  1.262S(X12)  ♦  1.2626(X13)  +  1.262SCX14)  ♦  1.262SCX15) 

♦  I.2626(X16)  -  1.2311  CXI  XX12)  -  1.231KX2KX13) 

-  1.23X1  (X3HX14)  -  1.231KX4) (X15)  -  1.2311 (X5) CX1S) 

SUBJECTED  TO: 

G1(X)  »  0.034750(X1)(XS**-1.00>  +  0.975000CX1)  -  0.009800CX1**  2.00XXB«*-1.00)  <»  1 

G2CX)  -  0.0347S0(X2XX7**-1.00)  +  0.975000CX2)  -  0.009800CX2**  2.00XX7**-1.00)  <■  1 

G3(X)  »  0. 034750  (X3XX8**-1. 00)  ♦  0.975000CX3)  -  0.009800CX3**  2.00XX8**-1.00)  <*  1 

G4(X>  -  0 . 034750 ( X4 ) ( X9**-l . 00 )  +  0.975000CX4)  -  0. 009800CX4**  2.00XX9**-1.00)  <*  1 

C5(X)  -  0.034750(X5XX10**-1.00)  +  0.975000(X5>  -  0.009800CX5**  2.00)(X10**-1.00)  <=  1 

G6(X)  «  (X6XX7**-1.00)  +  <X1XX7**-1.00XX11**-1.00XX12>  -  (X6XX7**-1.00XX11*«-1.00HX12)  <-  1 

G7CX)  *  CX7)(X8**-1.00)  «■  0.002000(X7)(X8**-1.00KX12) 

♦  0. 002000 (X2) (X8**-1.00XX13)  -  0.002000CX13)  -  0.002000CX1XX8**-1.00XX12)  <■»  1 

G8CX)  ■  (X8)  +  0. 002000 (X8HX13)  +  0.002000CX3XX14)  +  (X9)  -  0.002100(X2)  (X13) 

-  0. 002100 ( X9 ) (X14)  <=  1 

C9CX)  ■  (X3**-1.00XX9)  +  (X3**-1.00XX4XX14**-1.00XX15)  +  500. 00(X3**-1 . 00) (X10) (X14«**-1.00) 

-  501.00(X3**-1.00)(X9)(X14**-1.00) 

-  (X3**-i.00XX8XXl4**-1.00XX15)  <=  1 

G10(X)  -  0. 990000  (X4**-l.  00  XX5) (X15**-l .00) CX1B) 

+  0.990000 (X4**- l .00) (X10)  +  499.00(X15**-1.00) 

-  1.1000<X15**-1.00XX1S)  -  501.00(X4**-1.0DXX)OXX15»*- 1 .00)  <=  1 

Gll(X)  •  0.880000CX4**-1.00)  +  O.OOPOOO(XIB)  -  0.002200(X4**-1 . 00 ) ( X5 XXJB)  <=  1 
G12CX)  -  0.002000CX11 )  -  0.002000(X12)  <«  1 

G13(X)  *  (Xli**-l.00)(X12)  <*  1 

G14(X)  ■  (X4)(X5**-1.00)  <■  1 
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G15<X)  ■  (X3XX4**-1.00)  <-  1 
G16(X)  ■  (X2XX3**-1.00>  <»  1- 

C17(X)  -  (X1XX2**-1.00)  <»  1 

G1B(X)  ■  <X3XX10**-1.00)  <■  1 

G19(X)  ■  CX8KX9**-1.00)  <-  1 

GSO(X)  -  1.1111CX3)  <-  1 

GS1(X)  -  1.111KX4)  <»  1 

G22CX)  -  0. 900000 (X5**-l. 00)  <■  1 
G23(X)  -  lO.OOOO(XG)  <=  1 
G24(X)  *  0.100000(X7**-1.00)  <»  1 
G2SCX)  -  500.00(X14**-1.00)  <=  1 
G36(X)  ■  500.00(X15*«-1.00)  <=  1 
G27CX)  «  1.0E-OOG<XIG**-1.00)  <-  1 


Slgnomlal  Form;  Primal  Solutions  and  Starting  Point  Files 
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PROBLEM  MO  1-1 
SOLUTION  : 

(  8.1301.  0.615368,  0.564042.  5.6362) 
STARTING  POINTS  : 

NO  1  »  (  8.1057.  0.628351.  0.364381.  5.6574) 

NO  2  «  <  6.2548,  0.719659,  0.427716.  5.6274) 

NO  3  =  (  6.2207,  0.649534,  0.415851,  5.6541) 

NO  4  =»  (  6.5015,  0.573547,  0.400944,  5.6468) 

NO  5  *  <  5.6104,  0.550418,  0.476718,  5.6167) 

HO  6»  (  8.1632,  0.663106,  0.366412,  5.6526) 
NO  7  ■  (  5.4532,  0.659151,  0.494682,  5.6462) 

NO  8  »  (  5.7133,  0.645669,  0.457506,  5.6611) 

NO  9  =  (  6.6075,  0.531670,  0.402689,  5.6361) 


NO  10  «  (  6.5931,  0.734362,  0.413470,  5.6514) 


PROBLEM  MO  1-2 


SOLUTION  * 

(  8.1301*  0.615368*  0.564042*  5.6362) 
STARTING  POINTS  : 

NO  1  -  <  7.7815*  0.634553*  0.522380.  6.6402) 

NO  2  »  (  7.72S2*  0.530641,  0.477555.  6.2643) 

NO  3  -  (  7.3383,  0.640407*  0.640326*  6.2081) 

NO  4  -  (  7.2063*  0.668051*  0.616745.  6.2281) 

NO  5  -  (  7.7566.  0.560861,  0.466273.  5.6270) 

NO  6  -  (  7.4347,  0.696034.  0.524641.  6.2492) 

NO  7  -  C  7.7469.  0.670657.  0.497031. .6.3400) 

NO  8  =  (  7.0609.  0.526088,  0.559544,  5.8610) 

NO  9  a  (  7.1573,  0.560656.  0.522456.  6.2624) 

NO  10  *  (  7.7294.  0.685576.  0.540562.  6.4877) 


PROBLEM  MO  2-1 
SOLUTION  s 

(  52.6009.  1.1869.  24.7980.  0.408687) 
STARTING  POINTS  : 

NO  1  =  <  68.2065.  1.6134.  29.0510.  0.384794) 

NO  2  -  C  41.6520.  1.5211.  18.7360.  0.302417) 

NO  3  *  (  39.9813.  1.4775.  29.3659.  0.280381) 

NO  4  *  (  38.4519.  1.5797,  25.2471.  0.302295) 

NO  5  »  (  42.3744,  1.5675,  32.9390,  0.392482) 

NO  B«(  46.9631,  1.2794,  20.2188,  0.590697) 
NO  7  *  (  62.9266.  1.5409,  22.0829,  0.544536) 

NO  8  =  (  76.8066,  1.2291,  28.2350,  0.4S3155) 

NO  9  «  (  39.8044,  1.3076,  33.2485,  0.512354) 

NO  10  =  (  37.6591,  1.4409,  30.5907,  0.515989) 


PROBLEM  MO  2-2 


SOLUTION  s 

(  52.B009.  1.1869.  24.7980.  0.408687) 
STARTING  POINTS  : 

NO  1  =  (  58.8431.  1.3575.  26.4992,  0.399130) 

NO  2  =  (  48.2213,  1.3206,  22.3732,  0.366179) 

NO  3  *  (  47.5531,  1.3031.  26.6251,  0.357365) 

NO  4  »  (  46.9413,  1.3440,  24.9776,  0.366130) 

NO  5  *  (  48.5103,  1.3391.  28.0544,  0.402205) 

no  e>(  50.3458,  1.2239,  22.9663,  0.481491) 
NO  7  =  (  56.7312,  1.3285,  23.7119,  0.463027) 

NO  8  »  (  62.2832,  1.2038,  26.1728,  0.430474) 

NO  9  a  <  47.4823,  1.2352,  28.1782,  0.450154) 

NO  10  »  (  46.6242,  1.2885,  27.1150.  0.451608) 


I 

I 

I 
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PROBLEM  MO  3-1 
SOLUTION  t 

(  0.000100*  0.993S73,  1.9399,  1.0001) 
STARTING  POINTS  S 

NO  1  ■  (  0.000125,  0.926877,  1.2426,  1.1960) 

NO  2  -  (  0.000111,  1.0976,  1.0764,  0.877413) 

NO  3  »  <  0.000113,  0.973347,  1.6504,  0.550537) 

NO  4  -  (  0.000122,  0.724077,  1.5599,  0.722890) 

NO  5  ■  (  0.000124,  0.948827,  1.4740,  0.656020) 

NO  6  -  (  0.000137,  1.1670,  1.4386,  0.904726) 

NO  7  «  (  0.000125,  1.3477,  1.6913,  0.794910) 

NO  8  »  (  0.000119,  1.2882,  1.2834,  0.968813) 

NO  9  -  (  0.000127,  1.3852,  1.6942,  1.0519) 

NO  10  »  (  0.000127,  1.3504,  1.9215,  0.773129) 


PROBLEM  MO  3-2 


SOLUTIOM  i 

(  0.000100. 
STARTING  POINTS  : 
NO  1  -  (  0.000110. 

NO  2  -  (  0.000104. 

no  3>  (  0.000105. 
NO  4  ■  (  0.000109. 

NO  5  -  (  0.000110, 

NO  6  »  (  0.000115. 

NO  7  -  (  0.000110. 

NO  8  »  (  0.000102. 

NO  9  a  (  0.000111, 

NO  10  a  (  0.000111. 


0.999973.  1.9999,  1.0001) 

0.970735,  1.S970,  1.0785) 
1.0390.  1.G305.  0.951014) 
0.989323.  1.8601,  0.820264) 
0.889615.  1.8239.  0.88S205) 
0.979515.  1.7896,  0.862457) 


1.0668. 

1.7754, 

0.961940) 

1.1391, 

1.8765. 

0.918013) 

1.1153, 

1.7133. 

0.987574) 

1.1540, 

1.8776, 

1.0208) 

1.1401. 

1.9686, 

0.909301) 
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PROBLEM  MO  5-1 
SOLUTION  : 

(  78.0000.  33.0000. 
STARTING  POINTS  : 

NO  1  -  (  100.50,  35.4S15, 
NO  8  «  (  82.0295,  33.3329, 
NO  3»(  86.8346,  37.0309, 

NO  4=  (  90.9677,  40.5841, 

NO  5  ■  (  89.7803,  40.4919, 

NO  6  =  (  99.5187,  33.3920, 

NO  7  a  C  78.0605,  33.3289, 

NO  8  -  (  93.0024,  35.5475, 

NO  3=(  78.4972,  35.3481, 
NO  10  =  (  86.1427,  38.1545, 


29.9957,  45.0000,  36.7753) 


38.8361,  37.8710,  28.6243) 


37.8173, 

28.0470, 

29.6721) 

41.5272, 

32.9536, 

38.7201) 

40.0037, 

35.6493, 

32.2644) 

40.4457, 

38.4262, 

30.1009) 

37.9493, 

31.6024, 

41  .  1494) 

39.6590, 

29.1210, 

31.3703) 

39.5616, 

32.8626, 

34.4998) 

43.2623, 

36.4196. 

32.594?) 

39.1833, 

31.9787, 

29.6865) 

t 


PROBLEM  MO  5-2 


SOLUTION  J 

(  78.0000 
STARTING  POINTS 
NO  1  =  C  87.0003 
NO  2  a  (  79.6118 
NO  3  =  (  81.5339, 
NO  4  =  (  82.7121, 
NO  5=  (  8S.S075, 
NO  S>(  78.0242, 
NO  7  =>  (  88.0010, 
NO  8=(  79.7849, 
NO  9  =  (  78.1989. 
NO  10  =  (  88.5190, 


33.0000,  29.9957 

33.9968,  33.5319 
33.1332,  33.1244 
34.6123,  34.6083 

35.9968,  34.1757, 
33.1568,  33.1772 
33.1316,  33.8610, 
34.0190,  33.8221, 
35.8989,  34.0212, 
33.9393.  35.3024, 
34.9989,  31.4040, 


45.0000,  36.7753) 

42.1484,  33.5149) 
38.2183,  33.9340) 
40.1814,  37.5532) 
42.3705,  34.1055) 
39.6410,  38.5649) 
38.6484,  34.6133) 
40.1451,  35.8651) 
42.9372,  32.8043) 
41.5673.  35.1029) 
40.5922,  33.8459) 
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PROBLEM  NO  G-l 


SOLUTION 


(  1.5360. 
STARTING  POINTS  : 
NO  1»(  1.5882. 
NO  2  =  (  1.5719. 
NO  3  »  (  1.5856. 
NO  4  =>  (  1.5758, 
NO  5  =  (  1.5731. 
NO  6  ■  (  1.6752, 
NO  7  =  (  1.6192. 
NO  8  =  (  1.6623, 
NO  9  *  (  1.6117, 
NO  10  =  C  1.5835. 


1.0E-008, 

3.0000. 

0.400000. 

6.6670, 

8.0000 

B.9E-009. 

3.0337, 

0.401476, 

6.5773, 

7.9327 

7.8E-009, 

3.0176. 

0.403252. 

6.4190, 

7.8101 

1.0E-008, 

3.0276. 

0.402255, 

6.3897, 

7.7998, 

7.2E-009, 

3.0178, 

0.403329, 

6.5429, 

7.8943, 

7. EE-009. 

3.0286, 

0.402185, 

6.4691, 

7.8173, 

7.9E-009, 

3.0617, 

0.404248, 

6.3600, 

7.8975, 

8.8E-009. 

3.1592, 

0.401502, 

6.5086, 

7.8824, 

7.4E-009, 

3.0355, 

0.402302, 

6.2152, 

7.7183, 

6.9E-009. 

3.0452, 

0.405690, 

6.3023, 

7.9221, 

7.7E-009. 

3.0882, 

0.401267, 

6.5345, 

7.8943. 

149.51) 

108.29) 

103.08) 

98.1192) 

105.18) 

103.60) 

115. 14) 

103.69) 

123.27) 

115.60) 

103.14) 


PROBLEM  MO  B-2 


SOLUTION  s 

(  1.5360.  1.0E-008,  3.0000. 

STARTING  POINTS  : 

NO  1  *  (  1.5569,  8.8E-009,  3.0135. 

NO  2  *  (  1.5504,  9.1E-009,  3.0071. 

NO  3>  (  1.5558,  1.0E-008,  3.0110, 

NO  4  =  (  1.5519,  8.9E-009,  3.0071, 

NO  5  =  (  1.5508,  9.0E-009,  3.0114, 

NO  6  =  <  1.5917,  9.2E-009,  3.0247. 

NO  7  *  (  1.5693,  3.5E-009,  3.0637, 

NO  8  =  C  1.5865.  9.0E-009,  3.0142, 

NO  9  «  (  1.5663,  8.8E-009,  3.0181, 


0.400000, 

6.6670, 

8.0000, 

149.51) 

0.400590, 

6.6311, 

7.9931, 

133.02) 

0.401301, 

6.5678, 

7.9240, 

130.94) 

0.400902. 

6.5561, 

7.9199, 

128.95) 

0.401332, 

6.6173, 

7.9577, 

131.78) 

0.400874, 

6.5878, 

7.9269. 

131.14) 

0.401699, 

6.5442, 

7.9590, 

135.76) 

0.400601, 

6.6037, 

7.9530, 

131.18) 

0.400921, 

6.4863, 

7.8873. 

139.01) 

0.402276, 

6.5211, 

7.9688, 

135.94) 

NO  10  =•  (  1.5550,  9.1E-009.  3.0353,  0.400507,  6.6140,  7.9577,  130.96) 
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PROBLEM  MO  7-1 
SOLUTION  t 

(  0.245485,  8.1970,  8.2728, 
STARTING  POINTS  S 

NO  1  »  (  0.283507,  6.8854,  8.2818, 

NO  2  >  (  0.282461,  5.9345,  9.0908, 

NO  3  a  (  0.275239,  7.4582,  9.0813, 

NO  4  >  (  0.288742,  6.2486,  9.2512, 

NO  5  =  (  0.301457,  7.0203,  8.0919, 

NO  6  «  (  0.299984,  7.1783,  8.1551, 

NO  7  a  (  0.294854,  6.4566,  9.5608. 

NO  8  =  (  0.290556,  5.6665,  9.2453, 

NO  9  a  (  0.312850,  5.9828,  8.2076, 

NO  10  a  (  0.275709,  7.6027,  8.0918, 


0.245488,  1.8E+008,  21.3393,  27.7408) 


0.287684, 

1.4E+Q08, 

23.9525, 

34.8307) 

0.320009, 

1.8E+008, 

21.7391, 

33.1972) 

0.278507, 

1.4E+008, 

21.4388, 

35.9301) 

0.301732, 

1.5E+0C8, 

23.2965, 

34.4532) 

0.304828. 

1.6E+008, 

18.2918, 

32.9435) 

0.301242, 

1.5E+008, 

22.0897, 

33.0936) 

0.299750, 

1 .8E+008, 

22.7052, 

35.0714) 

0.300622, 

1.5E+008, 

24.4893, 

32.5990) 

0.316598, 

1.7E+008, 

19.1277, 

28.1352) 

0.311877, 

1.7E+008, 

18.5721, 

32.4813) 
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PROBLEM  NO  7-2 
SOLUTION  : 


(  0.245485.  6.1970.  8.2726. 
STARTING  POINTS  : 

NO  1  =  C  0.261432.  6.0822.  8.9636. 
NO  2  =  (  0.261337.  6.8330.  8.2467. 
NO  3  «  (  0.254943.  6.5314,  8.6373. 
NO  4  »  (  0.263330.  6.1633.  8.3471. 
NO  5  *  (  0.267137.  6.3108,  8.4364, 
NO  6>  (  0.240239.  6.3362.  8.7328. 
NO  7»(  0.261711,  6.3810.  8.5919. 
NO  8  -  (  0.264054,  S.9783,  8.7974, 
NO  9  »  (  0.257028,  6.0372,  8.6365. 


0.245488,  1.8E+008,  21.3393.  27.7408) 


0.265791, 

1.7E+008, 

22.2948. 

30.6096) 

0.262402. 

1.7E+008, 

20.9365, 

30.3124) 

0.270589, 

1 .8E+008, 

21.7892, 

30.7604) 

0.274898, 

1.8E+008, 

21.4009, 

30.2702) 

0.269286, 

1.8E+008, 

21.9383, 

30.9559) 

0.271734, 

1.8E+008, 

22.7511. 

30.5737) 

0.266452, 

1.7E+008, 

22.9564, 

30.0083) 

0.268570, 

1.8E+008, 

22.2546, 

30.6400) 

0.273977, 

1.8E+008, 

22.2574, 

30.2022) 
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PROBLEM  NO  8-2 
SOLUTION  l 

(  1698.01.  53.3569.  3031.94.  90.0714.  95.0000.  10.5456.  153.53) 
STARTING  POINTS  : 

NO  1  ■  (  1530.54.  52.6886.  2708.00.  30.1608.  95.0000.  11.5003.  153.42) 
NO  2>  (  1538.12.  55.7571.  2702.05.  90.1291.  95.0000.  11.4783.  153.38) 
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PROBLEM  NO  9-1 
SOLUTION  t 


< 

6.4810,  2.2179, 

0.666969, 

0.535832, 

5.9300, 

5.5271, 

1.0092,  0 

.400467) 

STARTING 

POINTS  : 

NO 

1  ■ 

( 

5.0175,  2.1079, 

0.799084, 

0.502201, 

6.0199, 

6.6925, 

0.947077, 

0.388499) 

NO 

2  - 

( 

5.1677,  2.0075, 

0.679073, 

0.515244, 

6.0351, 

6.7144, 

0.988460, 

0.302427) 

NO 

3  * 

( 

5.0117,  1.7089, 

0.658526, 

0.633554, 

5.9508, 

6.2338, 

0.814804, 

0.384846) 

NO 

4  * 

( 

4.3080,  1.9720, 

0.598054, 

0.546640, 

6.0914, 

5.8912, 

1.0248,  0 

.405226) 

NO 

5  => 

( 

5.4415,  2.0320, 

0.796953, 

0.623089, 

6.0175, 

6.1605. 

0.788410, 

0.317377) 

NO 

6  = 

( 

5.5488,  2.5601, 

0.629372, 

0.717721, 

5.8717, 

6.5761, 

0.856932, 

0.476052) 

NO 

7  * 

( 

4.8749,  2.1847, 

0.814495, 

0.516258, 

6.0583, 

6.4503. 

0.924717, 

0.377815) 

NO 

8  - 

( 

5.5205,  1.8535, 

0.533308, 

0.577560. 

6.0660. 

6,4712. 

0.797346, 

0.376559) 

NO 

9  * 

( 

6.2818.  2.2707, 

0.734797, 

0.531583, 

6.0387, 

7.0190, 

0.814931, 

0.340567) 

NO  10  *  (  4.8394,  1.8952,  0.808771,  0.449090,  8.0878,  5. 9108,  0.978795,  0.485350) 
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PROBLEM  MO  9-3 

• 

SOLUTION 

: 

( 

5.4810,  2.2175, 

0.666969, 

0.595832. 

5.9300, 

5.5271, 

1.0092,  0.400467) 

STARTING 

POINTS  ! 

NO 

1  » 

( 

5.9530,  2.1752. 

0.717996. 

0.559669. 

6.3725, 

5.9772, 

1.0434,  0.335845) 

NO 

2  * 

C 

5.9900,  2.3890. 

0.705763. 

0.536767, 

6.0274, 

5.9755, 

1.0128,  0.380027) 

NO 

3  = 

( 

5.3227,  2.1131. 

0.605508. 

0.595316, 

6.0218, 

6.0899, 

0.956342,  0.433144) 

NO 

4  = 

( 

5.8526,  1.9803, 

0.663048, 

0.613354, 

6.2914, 

5.8582, 

0.940396.  0.393211) 

NO 

5  * 

c 

5.9683,  2.1781. 

0.616980. 

0.546914, 

6.3918, 

5.5302, 

0.946361,  0.369038) 

NO 

6  » 

( 

6.3375.  2.1392. 

0.721875, 

0.607346, 

6.4628, 

5.7947, 

0.941621.  0.365370) 

NO 

7  = 

c 

S.8909,  2.2C52, 

0.722532, 

0.565862, 

6.4523, 

5.8748, 

1.0307,  0.391936) 

NO 

8  = 

( 

6.3208,  2.0758. 

0.614925. 

0.588718, 

6.4829, 

5.8947, 

0.940173.  0.391158) 

NO 

9  = 

( 

5.9226,  2.1770. 

0.705116. 

0.560157, 

6.0754. 

6.0701, 

1.0236,  0.432864) 

NO 

10  * 

( 

5.9127,  2.1614, 

0.659951, 

0.520887, 

6.1542. 

5.9899. 

1.0288.  0.398622) 
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PROBLEM  MO  10-1 
SOLUTION  t 


(  574.80.  1384.73.  S109.S7, 
STARTING  POINTS  : 

W  1«(  752.99.  1505.55.  8004.25. 
NO  2  ■  (  722.53.  1608.63.  6404.44. 
NO  3  =  (  653.54.  1642.10.  6933.35. 
NO  4  ■  C  762.12.  1477.24.  5676.54, 
NO  5  -  (  718.71.  1682.31.  5665.41. 
NO  6  a  (  607.48.  1771.52.  6480.63, 
NO  7  *  (  721.04.  1665.43,  5920.24, 
NO  8*  (  574.56.  1488.15.  7223.82. 
NO  9  *  (  713.87.  1604.23.  6529.52. 
NO  10  »  (  626.34,  1832.32.  5447.06, 


181.64,  295.61,  218.36.  286.03,  395.61) 


176, 

.15. 

293, 

.34. 

213. 

.30. 

280. 

.07, 

386. 

.04) 

177, 

.75, 

294. 

.16. 

215. 

.74, 

283. 

.48, 

392. 

,55) 

177, 

.08. 

289. 

,47. 

218. 

.23. 

287. 

.37, 

389. 

.26) 

178, 

.51. 

286. 

,90. 

212. 

,83. 

287. 

.83. 

380. 

,93) 

183. 

,33. 

287. 

,65, 

215. 

.74, 

277. 

.43. 

384. 

.99) 

180. 

,75. 

296. 

,77. 

213. 

,89. 

279. 

.23. 

393. 

,08) 

184. 

,57. 

289. 

,94. 

211. 

,37. 

285. 

,03. 

389. 

,68) 

174. 

92. 

285. 

22. 

219. 

26, 

2B1 . 

65. 

372. 

.07) 

181. 

,80. 

293. 

31, 

215. 

,04. 

280. 

,98. 

3B7 . 

,37) 

176. 

,70. 

297. 

20, 

218. 

,86. 

277. 

,06. 

396. 

.77) 

PROBLEM  MO  10-2 

• 

SOLUTION 

: 

< 

574.80. 

1364.79, 

5109.67, 

181.64, 

295.61. 

218.36, 

286.03, 

395.61) 

STARTING 

POINTS 

• 

• 

MO 

1  =»  ( 

639.47, 

1493.87, 

5419.32, 

172.71, 

291.18, 

227.28, 

281.24, 

389.69) 

MO 

2  -  ( 

576.88, 

1520.40, 

5880.29, 

179.19, 

295.23, 

218.76, 

280.89, 

392.41) 

NO 

3  «  ( 

670.75, 

1351.61, 

5478.78, 

177.61, 

291.76, 

217.86, 

285.41, 

387.53) 
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PROBLEM  MO  11-1 
SOLUTION  » 


( 

30.0000. 

20.0000. 

1.000000, 

0.416339, 

8.043S, 

5.2292. 

7.6894, 

5.5498) 

STARTING 

POINTS  : 

NO 

1  - 

( 

29.904B. 

20.4201. 

0.813318. 

0.376984, 

7.5564, 

6.5176. 

7.8453. 

6.5153) 

NO 

2  - 

( 

29.9889, 

20.1459. 

0.706576, 

0.356304, 

7.4495, 

6.0150. 

7.9648, 

6.0155) 

NO 

3  ■ 

( 

29.80S0. 

20.6638, 

0.780375, 

0.336272, 

7.8523, 

6.1912, 

7.9352, 

6.3889) 

NO 

4  - 

( 

29.7289. 

20.6271, 

0.831167, 

0,362491. 

8.7355, 

6.6466, 

7.9139, 

6.1502) 

NO 

5  - 

( 

29.9198. 

20.0826. 

0.747964, 

0.325960. 

7.5908, 

5.7924, 

7.9065. 

6.5143) 

NO 

6  ■ 

( 

29.9138. 

20.3698. 

0.784867, 

0.281819, 

8.9610, 

5.8803. 

7.7622, 

6.0680) 

NO 

7  - 

( 

29.5380. 

20.5802. 

0.755409, 

0.517750. 

7.3934, 

6.0694. 

7.7616. 

6.0825) 

NO 

8  ■ 

c 

29.7858, 

20.4716, 

0.843403. 

0.3S8SS1. 

7.7600, 

6.4206, 

7.9081, 

6.6864) 

NO 

S  ■ 

( 

29.7998* 

20.3500, 

0.8S5039, 

0.327134, 

9.8411, 

5.6459, 

7.8052, 

6.8423) 

NO 

10  - 

( 

29.8622. 

20.5159. 

0.977180, 

0.332574, 

9.4592, 

6.1633, 

7.8601, 

6.9010) 

PROBLEM  MO  11-2 


SOLUTION  1 


( 

30.0000. 

20.0000. 

1.000000, 

0.416339, 

8.0435, 

5.2292, 

7.6894, 

5.5498) 

STARTING 

POINTS  : 

NO 

1 

ss 

( 

29.9203. 

20.1512. 

0.910265, 

0.383S25, 

7.9654, 

5.6222. 

7.7898, 

5.8926) 

NO 

2 

3 

( 

29.9094. 

20.1417. 

0.945025, 

0.410216. 

7.6388. 

5.6910, 

7.6786, 

6.0923) 

NO 

3 

3 

( 

29.8662, 

20.2234, 

0.917054, 

0.416298. 

7.5987. 

5.3888. 

7.6858, 

6.1646) 

NO 

4 

3 

C 

29.9041. 

20.2446, 

0.931523. 

0.424867, 

8.0743. 

5.8155, 

7.7883, 

5.8727) 

NO 

5 

a 

C 

29.9396. 

20.1162. 

0.891552, 

0.394S34, 

7.9113, 

5.2899, 

7.7587, 

6.0457) 

NO 

6 

a 

( 

29.9135, 

20.0894. 

0.902909. 

0.362024, 

3.3745. 

5.4479, 

7.6946, 

5.6693) 

NO 

7 

a 

( 

29.8816, 

20.1310, 

0.946223. 

0.376730, 

8.2800, 

5.7197, 

7.7494, 

5.9177) 

NO 

8 

M 

( 

29.8885. 

20.1157, 

0.886221, 

0.417565, 

8.3800, 

5.4367, 

7.7190, 

5.9910) 

NO 

S 

3 

( 

29.9241. 

20.0952. 

0.925786. 

0.442552, 

7.6010, 

5.6279, 

7.7067, 

6.0058) 

NO 

10 

3 

( 

29.8997. 

20.1858, 

0.935117, 

0.434939, 

8.8731. 

5.4002, 

7.6871, 

6.0942) 
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PROBLEM  NO  12-1 
SOLUTION  * 

(  17.8264.  1.0E-008,  1.2323.  3.2032.  40.0000.  0.987081.  24.6453.  6. 6670. 

STARTING  POINTS  : 


8.0000) 


NO  1  =  (  17.7765.  8.8E-009.  1.6432,  3.0061,  40.0157,  0.960220,  24.3516,  6.4257,  7.8299) 


PROBLEM  NO  12-2 
SOLUTION  : 

(  17.8264*  1.0E-008*  1.2323*  3.2032* 

STARTING  POINTS  : 

NO  1  =  (  19.2499*  1.1E-008*  1.3467,  3.0886* 

NO  2  =  (  19.4109,  9.1E-009*  1.3051,  3.0154, 

NO  3  «  (  19.5246*  1.0E-008*  1.3417,  3.0069* 

NO  4  =  (  19.6469*  9.9E-009,  1.3314,  3.0161* 

NO  5  *  (  19.6378*  9.5E-009*  1.3041,  3.0049* 

NO  6  a  (  19.9444,  9.6E-009,  1.2255,  3.0115, 

NO  7  *  (  19.8493*  9.7E-009*  1.3270,  3.0711, 

NO  8»  (  19.4276*  1.0E-008,  1.3514*  3.0249, 

NO  9  a  (  18.5611*  l.lE-00a.  1.3400*  3.0880* 

NO  10  *  C  19.7258.  9.0E-009,  1.2382*  3.0209, 


40.0000* 

0.987081, 

24.6453* 

6.6670,  8.0000) 

40.0116* 

0.995226, 

24.8031, 

6.6263,  7.9637) 

40.1442, 

0.979916, 

24.8986, 

6.5824,  7.9309) 

40.2178* 

0.987671, 

24.6850, 

6.6064,  7.9412) 

40.0262* 

0,996480, 

24,6479* 

6.5715*  7.9927) 

40.6374* 

0.985578, 

25.0366* 

6.6337, 

7.9990) 

40.3502* 

0.982768, 

24.3216, 

6.5634, 

7.9169) 

40.1777, 

0.984030, 

24.4706, 

6.6130, 

7.9694) 

40.1484* 

0.990211, 

24.6132, 

6.6059, 

7.9859) 

40.3801, 

0.977291, 

24.7013, 

6.5662,  7.9886) 

40.1159, 

0.980227, 

24.3241, 

6.6254,  7.9711) 
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PROBLEM  NO  13-1 


SOLUTION  i 


(  57.6923,  34.1478.  57.6923.  1.0500.  104.19.  46.5010.  32.6923.  46.5010.  30.5203) 
STARTING  POINTS  : 

NO  1  »  (  58.9067,  32.9226.  56.5912,  1.3583,  87.7983,  45.6421,  32.0687,  47.9642,  31.5034) 
NO  2  =  (  58.5523.  34.4512,  57.1795,  1.1811,  70.3982,  45.0163,  32.5326,  48.2006,  31.0288) 
NO  3  =  (  59.8054,  36.0838,  57.6802,  1.3405,  94.0966,  43.6916,  32.4197,  47.1088,  31.4522) 
NO  4  =  (  59.8708,  33.1053,  56.4510,  1.3407,  84.0568,  45.3695,  33.3511,  46.7462,  31.1486) 
NO  5  “  (  58.9144,  33.5194,  57.3664,  1.3662.  84.3079,  45.7239,  32.6248,  46.6473,  31.3681) 
NO  6  *  (  57.2811,  33.8340,  56.6037,  1.3570,  84.8876,  44.7901,  31.7143,  45.5124,  30.3585) 
NO  7  *  (  59.8326,  33.8312,  56.9527,  1.3877,  93.8653,  45.1650,  31.3129,  46.4069,  30.9239) 
NO  8  =  (  59.3187,  35.2483,  59.5257,  1.2109,  74.1607,  47.8050,  31.8593,  48.0410,  31.0029) 
NO  9  «  (  55.7180,  33.9708,  57.7023,  1.4078.  99.7801,  46.0123,  31.7312,  47.9576,  31.1371) 
NO  10  =  (  58.1089,  33.1897,  55.9499,  1.3361,  83.0471,  44.8339,  31.9253,  45.6980,  30.8671) 


PROBLEM  MO  13-2 


SOLUTION  : 

C  57.6923,  34.1476.  57.6923,  1.0500, 
STARTING  POINTS  : 

NO  1  ■  (  56.6722,  35.7528,  58.4369,  1.1143, 

NO  2  *  (  57.8992,  35.6660,  58.1578,  1.1807, 

NO  3  =  C  56.2808-  36.0506,  58.4706,  1.1032, 

NO  4  =  C  57.2510,  35.4277,  58.3429,  1.1429, 

NO  5  =  C  57.5982,  33.8818,  58.7557,  1.1403, 

NO  6  =  (  57.3298,  34.1492,  57. £ 'll,  1.1715, 

NO  7  *  (  58.8491,  35.2363,  58.9637,  1.1575, 

NO  8  =  (  57.7223,  34.4269,  57.8394,  1.2015, 

NO  9  =  C  57.9579,  33.9261,  57.7951,  1.1566, 

NO  10  =  (  57.3232,  34.2993,  58.4439,  1.1511, 


104.19,  46.5010,  32.6923,  46.5010,  30.5203) 

94.1526,  46.0833,  32.0307,  48.0737,  30.7377) 
103.21.  45.7836,  32.5498,  48.5147,  30.8722) 
94.9450,  46.0082,  32.0995,  48.3862,  30.6385) 
100.82,  45.7911,  31.7561,  47.6668,  31.3719) 
95.7659,  47.2409,  32.1105,  48.6787,  30.8854) 

96.0602,  46.3063,  32.4609,  4B.2191,  30.7998) 

99.0499,  45.7137,  32.8700,  47.3196,  30.9586) 

102.84,  46.2782,  32.7084,  47.2173,  30.8242) 
93.5229,  46.1033,  32.7807,  46.8569,  30.8175) 

94.5383,  47.0958,  32-4643.  48.2202,  30.7881) 


141 


PROBLEM  MO  14-1 
SOLUTION  : 


< 

11.7660. 

0.371346. 

0.342312.  12.2734, 

14.2344. 

0.400000, 

38.3594, 

0.719656, 

0.130695) 

STARTING 

POINTS  : 

NO 

1  - 

( 

11.6031. 

0.272973, 

0.400766,  12.5913, 

14.3238. 

0.418133, 

41.5309, 

0.732878, 

0.137098) 

NO 

2  ■ 

( 

11.5949. 

0.303689, 

0.377265,  11.9999, 

13.7886, 

0.425037, 

45.6996, 

0.757215, 

0.136657) 

NO 

3  * 

( 

11.5315. 

0.293268, 

0.407190,  12.4605, 

13.8009. 

0.405423, 

41.2724, 

0.766394, 

0.138342) 

NO 

4  = 

( 

11.8989. 

0.273110, 

0.362774,  12.3646, 

13.7709, 

0.403951, 

46.4365, 

0.744475, 

0.134899) 

NO 

5  a 

c 

11.8169. 

0.346776, 

0.418303,  12.1494, 

13.7972, 

0.416651, 

47.8849, 

0.738932, 

0.133668) 

NO 

6  « 

( 

11.6754, 

0.256354, 

0.353487,  12.1755, 

14.0045, 

0.411820, 

44.8922, 

0.731053, 

0.133870) 

NO 

7  - 

( 

11.6030. 

0.317193, 

0.406245.  12.2783, 

14.5157, 

0.400389, 

48.9057, 

0.728756, 

0.132975) 

NO 

8  = 

< 

11.8438. 

0.301142, 

0.373331,  12.2411, 

14.0348, 

0.406035, 

49.7014, 

0.736292, 

0.132025) 

NO 

9  a 

( 

11.8091, 

0.308244, 

0.421226,  12.5948, 

14.2612, 

0.400001, 

46.5934, 

0.721742, 

0.134824) 

NO 

10  « 

( 

11.8944. 

0.274492. 

0.407973,  12.3616, 

13.9607, 

0.407146, 

43.9402, 

0.737737, 

0.133902) 

PROBLEM  MO  14-2 


SOLUTION  : 


( 

11.7660. 

0.371346, 

0.342312, 

12.2734, 

14.2344, 

0.400000, 

38.3534, 

0.719656. 

0.130695) 

STARTING 

POINTS  : 

NO 

1  = 

( 

11.8202, 

0.331271, 

0.350659. 

12.3106, 

14.1010, 

0.401612, 

41.6544, 

0.729780, 

0.132410) 

NO 

2  = 

( 

11.6267, 

0.364463. 

0.385829. 

12.2366, 

14.3226, 

0.404812, 

40.2729, 

0.725684. 

0.132428) 

NO 

3  « 

( 

11.6222, 

0.349662, 

0.350410. 

12.2958, 

14.3614, 

0.402612, 

43.1436. 

0.722622, 

0.132648) 

NO  4  *  (  11.6630.  0.346663.  0.361218.  12.3157.  14.3286.  0.400536,  42.0408.  0.733716,  0.133581) 


r 
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PROBLEM  MO  15-1 
SOLUTION  > 

<  0.724310.  0.723S75.  0.724185.  0.257577.  0.177137.  0.121792.  0.205240.  0.141145.  0.097045. 
0.298522) 

STARTING  POINTS  : 

MO  1  ■  (  0.885143.  0.898727.  0.701987,  0.2513B9.  0  173597.  0.125480.  0.203351.  0.144152.  0.107233. 
0.30B945) 

NO  2  -  C  0.8479S7,  0.925640.  0.825330,  0.253377.  0.171897.  0.121B71,  0.202682.  0.141248,  0.1022B9. 
0.302391) 

NO  3  *  (  0.811277,  0.8G8714.  0.868784,  0.252688.  0.173085.  0.120379.  0.210527.  0.140165,  0.113611. 
0.306958) 

NO  4  *  (  0.782414.  0.866258.  0.526057.  0.254303,  0.180736,  0.118876,  0.211617.  0.144361,  0.096973. 
0.299525) 

NO  5  =  (  0.856169,  0.876012,  0.880297,  0.253798,  0.180010.  0.123228,  0.204776,  0.144632,  0.103387, 
0.304918) 

NO  6  =  (  0.826233.  0.828637,  0.935552.  0.249805,  0.174911,  0.121709,  0.210384,  0.140583,  0.097922, 
0.302780) 

NO  7  »  (  0.939807,  0.824469.  0.813875,  0.253083,  0.176404,  0.123863,  0.204196.  0.145098,  0.102201, 
0.306165) 

NO  8  *  (  0.925514.  0.736728.  0.885658,  0.251061,  0.174433.  0.124138,  0.201883.  0.142942,  0.099368, 
0.301411) 

NO  9  *  (  0.867507,  0.896304,  0.852750,  0.258599,  0.177316.  0.122037,  0.210377,  0.143764,  0.102638, 
0.302967) 

NO  10  -  (  0.847150,  0.879610,  0.878932,  0.253062,  0.174458,  0.119477,  0.209721,  0.139915,  0.098055, 
0.310303) 
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PROBLEM  MO  15-2 
SOLUTION  : 

<  0.724310.  0.723S75.  0.724185,  0.257577,  0.177137,  0.121732,  0.205240,  0.141145, 
0.238522) 

STARTING  POINTS  : 

NO  1  *  (  0.800G02,  0.735135,  0.746508,  0.249S55,  0.173370,  0.112553,  0.204009,  0.140455, 
0.302040) 

NO  2  »  (  0.7981S6,  0.7988S8,  0.747273,  0.241045,  0.16S837,  0.120E57,  0.206634,  0.141933, 
0.301148) 

NO  3  a  (  0.810508,  0.775783,  0.777489,  0.25029G,  0.1G5424,  0.11G225,  0.204962,  0.142273, 
0.301150) 

NO  4  *  (  0.734393,  0.810902,  0.GS2504,  0.258428,  0.174113,  0.123130,  0.20G741,  0.140477, 
0.302097) 

NO  5  «  (  0.821053,  0.789757,  0.7GG432,  0.253334,  0.172824,  0.114374,  0.207392,  0.142241, 
0.301217) 

NO  6  =  (  0.808189,  0.775342,  0.746325.  0.238810,  0.170457,  0.114329,  0.206155,  0.141290, 
0.300627) 

NO  7  =*  (  0.804433,  0.757050.  0.730558,  0.257872,  0.173470,  0.111330.  0.205957,  0.142077, 
0.302036) 

NO  8  *  (  0.80G478,  0.806894.  0.743752,  0.239014,  0.173142,  0.117592,  0.204745,  0.140699, 
0.300608) 

NO  9  *  (  0.801489,  0.810308,  0.675563,  0.255067,  0.169238,  0.118907,  0.204216,  0.141145, 
0.302012) 

NO  10  *  (  0.807950,  0.733402,  0.812145,  0.250976,  0.175483,  0.120921,  0.204556,  0.140637, 
0.302386) 


0.097045, 


0.101273, 


0.100567, 


0.098811, 


.101210, 


.098591, 


.099063, 


. 099405, 


.097075, 


.101231, 


.103266, 


/ 


PROBLEM  NO  IB-1 


SOLUTION  : 

(  2.0952,  12.0952,  7.9048,  0.459381, 

0.100000) 

* 

STARTING  POINTS  : 

NO  1  »  C  2.1540,  11.8235,  8.0440,  0.540846, 
0.099980) 

NO  2  «  (  2.1645,  11.9773,  7.8813,  0.583513, 
0.096613) 

NO  3  *  (  2.1436.  12.0699,  7.9221,  0.509337, 
0.09S819) 

HO  4  *  (  2.0679,  11.9307,  7.9958,  0.591329, 
0.097010) 

NO  5M  2.0824,  12.0195,  7.9573,  0.566162, 
0.099657) 

NO  6  »  <  2.0794,  11.9641,  8.0008,  0.577907, 
0.096622) 

NO  7«  (  2.0765,  11.9925,  7.9853,  0.591599, 
0.096762) 

NO  B>(  2.0733,  11.8203,  8.1261.  0.584185, 
0.099188) 

NO  9>(  2.0987,  11.9102,  7.9132,  0.584064, 
0.098671) 

NO  10  ■  <  2.1205,  11.8943,  7.9855,  0.541232, 


0.357935,  0.454747,  10.4547,  1.6405,  1.1975, 


0.339613,  0.516851,  10.1317,  1.6711,  1.5143, 


0.358778,  0.532515.  10.1133,  1.6526.  1.3498, 


0.321325,  0.605544,  10.1927,  1.6796,  1.2208, 


0.388459,  0.519907,  10.1137,  1.6302,  1.3527, 


0.410826,  0.514167,  10.2230,  1.6522,  1.4671, 


0.395934,  0.444950,  10.1410,  1.6544,  1.4676, 


0.403974,  0.534048,  10.1633,  1.6614,  1.2611, 


0.440265.  0.517903,  10.1416,  1.6605,  1.2429, 


0.433543,  0.493334,  10.2393,  1.6170,  1.3919, 


0.308966.  0.536208,  10.1381,  1.5382,  1.4648, 


0.098102) 


PROBLEM  NO  16-2 


SOLUTION 

( 

STARTING 
NO  1  =  ( 

NO  2  »  ( 

NO  3  *  ( 

NO  4  *  ( 

NO  5  =  ( 


t 


2.0952*  12.0952. 

0.100000) 

POINTS  : 

7.9048, 

0.459381, 

0.357935, 

0.454747, 

10.4547, 

1.6405, 

1.1975 

2.0830.  12.0193. 

0.097835) 

7.9331. 

0.488574, 

0.392031, 

0.475835, 

10.3626, 

1.6272, 

1.3236, 

2.1251.  11.9678. 

0.097539) 

7.9687, 

0.512452, 

0.342468, 

0.498969, 

10.3244, 

1.6421, 

1.2376, 

2.1117,  12.0705, 

0.094423) 

7.9009, 

0.492736, 

0.335943, 

0.502195, 

10.3660, 

1.6579, 

1.2464, 

2.1017.  12.0165. 

0.099861) 

7.9515, 

0.515554, 

0.395673, 

0.474221, 

10.3099, 

1.6422, 

1.2777, 

2.1068.  12.0463. 

7.9424, 

0.489870, 

0.367188. 

0.490971, 

10.3794, 

1.6272, 

1.2956, 

0.092790) 
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PROBLEM  NO  17-1 
SOLUTION  t 

(  0.731055.  0.713511.  0.702707,  0.2651B2.  0.182000,  0.124031.  0.197735.  0.13289S.  0.089318. 
0.294859) 

STARTING  POINTS  : 

NO  1  *  C  0.893388,  0.884882,  0.6811SS.  0.258771.  0.178363,  0.127788,  0.195915.  0.135728,  0.098894, 
0.302972) 

NO  2  -  (  0.855864,  0.911360,  0.800852,  0.260838,  0.1766.6,  0.123908.  0.195271.  0.132994.  0.094126, 
0.298477) 

NO  3  ■  (  0.818833.  0.855313,  0.843017,  0.260129,  0.177837,  0.122592,  0.202829,  0.131974,  0.104584, 
0.302985) 

NO  4  *  (  0.789701,  0.852895,  0.898591,  0.261792,  0.185698,  0.121061,  0.203879,  0.135924,  0.089251, 
0.295648) 

NO  5  -  (  0.864143,  0.862497,  0.854188,  0.261271,  0.184952,  0.125493,  0.197288,  0.136180,  0.095155, 
0.300971) 

NO  6  =  (  0.833928,  0.815854,  0.907804,  0.257161,  0.179713,  0.123946,  0.203269,  0.132367,  0.090125, 
0.298861) 

NO  7  =  (  0.948560,  0.811750,  0.789736,  0.260536,  0.181246,  0.126140,  0.196730,  0.136618,  0.094064, 
0.302202) 

NO  8  =  (  0.934134,  0.725362.  0.859390,  0.258454,  0.179222,  0.126420.  0.194501,  0.134589,  0.091456, 
0.297510) 

NO  9  3  (  0.875586,  0.882477,  0.827458,  0.266214,  0.182184,  0.124230,  0.202684,’  0.135362,  0.094465, 
0.299046) 

NO  10  -  (  0.855040,  0.865040,  0.852864,  0.260514,  0.179248,  0.12)674.  0.202053,  0.131739,  0.090247, 


0.306287) 
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PROBLEM  NO  17-2 
SOLUTION  : 

(  0.731055,  0.712511,  0.702707,  0.2S51S2,  0.182000,  0.124031,  0.197735,  0.132896, 
0.294659) 

STARTING  POINTS  : 

NO  1»(  0.808058,  0.782928,  0.724368,  0.257006,  0.178746,  0.114628,  0.196549,  0.132246, 
0.298131) 

NO  2  *  C  0.805599,  0.786544,  0.725109,  0.248143,  0.171418,  0.122875,  0.19907B,  0.133700, 
0.297250) 

NO  3  =  C  0.818056,  0.763815,  0.754429,  0.257667,  0.169966,  0.118361,  0.197467,  0.133958, 
0.297252) 

NO  4  -  C  0.786672,  0.791415,  0.781939,  0.254536,  0.175525,  0.123532,  0.196299,  0.134643, 
0.296316) 

NO  5--(  0.801792,  0.798352,  0.633151,  0.266038,  0.178893,  0.125393,  0.199181,  0.132268, 
0.298187) 

NO  6  =  (  0.828705,  0.777574,  0.743701,  0.260794,  0.177569,  0.116986,  0.199809,  0.133928, 
0.297319) 

NO  7  *  (  0.815716,  0.763381,  0.724190,  0.245842,  0.175136,  0.116431,  0.198616,  0.133033, 
0.296736) 

NO  8  =  (  0.646754,  0.736165,  0.701488,  0.249112,  0.179053,  0.119138,  0.196054,  0.131068, 
0.295850) 

NO  9  »  (  0.811991,  0.745371,  0.767111,  0.2:5466,  0.173232,  0.113377,  0.198426,  0.133774, 
0.298127) 

NO  10  ■  (  0.813989,  0.794446,  0.721694,  0.246052,  0.177895,  0  119753.  0.197258.  0.132476, 
0.296717) 


0.089318 


0.093209 


0.092S59. 


0.090943, 


0.091809. 


0.093152, 


0.090741, 


0.091176, 


.091556, 


.091490. 


. 089345, 
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PROBLEM  NO  18-3 
SOLUTION  » 

(  1 TBS. 29.  18676.,  36.8866,  3085.58.  1999.42.  92.0220.  95.0000.  11.T051.  2.0422. 
152.15) 

STARTING  POINTS  : 

NO  1  «  (  1783,14.  19031..  98.0549.  2931.33.  1909.74.  92.00S2.  94.9048.  11.6694.  2.0801. 
152.89) 

NO  2  -  (  1781.02.  18653..  100.87.  2937.52.  1952.36.  92.0205.  94.8560.  11.1183.  2.0304. 


152.93) 
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PROBLEM  MO  19-1 
SOLUTIOM  t 

(  0.804085.  0.839972.  0.991282.  0.100000.  0.190423.  0.900000.  538.84.  3G.38S6.  500.00. 

0.100000) 

STARTING  POINTS  i 

NO  1M  0.797310.  0.900011,  0.920G99,  0.093460,  0.193580,  0.882403,  440.21.  44.6834,  599.85, 


0.111278) 
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PROBLEM  NO  19-2 
SOLUTION  : 


( 

0.804085. 

0.899972, 

0.991282, 

0.100000, 

0.190423, 

0.900000, 

538.84, 

36.9866, 

500.00 

0.100000) 

STARTING 

POINTS  .' 

NO 

1 

B 

( 

0.801375, 

0.839987, 

0.9E3049, 

0.099384, 

0.191686, 

0.892961, 

499.39, 

40.0653, 

539.94 

0.104511) 

NO 

2 

3 

( 

0.79B980, 

0.900433, 

0.995813, 

0.099710, 

0.192626, 

0.895091, 

508.11, 

40.8669, 

526.53, 

0.105950) 

NO 

3 

3 

( 

0.801537, 

0.900152, 

0.914192, 

0.099522, 

0.190839, 

0.895719, 

489.77, 

37.9526, 

521.81, 

0.108639) 

NO 

4 

a 

( 

0.796544, 

0.900126, 

0.929714, 

0.099005, 

0.190821, 

0.891303, 

484.00, 

38.2368, 

535.02, 

0.104370) 

NO 

5 

a 

f 

0.799779, 

0.900187, 

0.907476, 

0.099255, 

0.191440. 

0.898918, 

494.82, 

38.4526, 

537.72, 

0.105919) 


152 


PROBLEM  MO  20-3 
SOLUTION  s 

(  7.0037,  7.S458.  7.3183,  0.012445,  0.811653.  0.955586,  0.381332,  0.358090, 
2.0764,  0.452995) 

START IMG  POINTS  : 

NO  1»(  6.9661,  7.6257,  7.0708,  0.012733,  0.807539,  0.954640,  0.379406,  0.379690, 
2.0791, 


0.3S2934, 


0.354385, 


0.452616) 


PROBLEM  NO  21-3 


SOLUTION  : 

(  0.392000.  0.034000.  1.0E-005.  0.481000.  0.E43000.  0.025132,  0.007000,  0.022006,  0.553037, 

1.3800,  2.3800,  0.123000,  0.335000) 

STARTING  POINTS  : 

NO  1  «  (  0.392174,  0.034083,  9.9E-00S,  0.483292,  0.638449,  0.025015,  0.00S901,  0.021984,  0.529723, 

1.3784,  2.3779,  0.118818,  0.317082) 


MICROCOPY  RE. SOLUTION  T t ST  CHARI 

NAIIONAl  RUM  All  Of  s!AN|>Ak|>s  A 
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PROBLEM  MO  22-2 
SOLUTION  t 

(  13115.'  36471.'  3212.00.  112.19'  370699.'  31.5086'  1.1E-008'  47399"  1469S9" 

7794.88'  19327"  362648"  14563.) 

STARTING  POINTS  » 

NO  1  ■  C  11899..  40037"  2918.34'  113.33'  374387"  33.0766.  1. IE-008.  46201..  147286.* 

7770.63.  19823"  362820..  14539.) 

NO  2  ■  (  12774"  40095"  3368.11*  113.19.  378852..  34.7106.  1. IE-008.  44339..  147742.. 

7807.66.  19729"  366445"  14446.) 


t 


PROBLEM  NO  33-1 


SOLUTION  i 

(  5154.08,  6.6300,  169485.,  743.89,  87999.,  189.54,  0.135831,  39.3653) 
STARTING  POINTS  : 

NO  1>(  6403.17,  6.6354,  168985.,  887.56,  79862.,  323.87,  0.104181,  38.3373) 
NO  2  ■  (  5806.06,  6.7473,  168389.,  931.16,  81850.,  306.44,  0.095633,  39.7379) 

NO  3  «  (  6811.50,  6.6364,  171127.,  890.93,  78086.,  322.31,  0.118333,  29.6090) 

NO  4  *  (  5015.05,  6.5385,  169885.,  856.75,  108347.,  243.43,  0.122467,  38.3349) 

NO  5>(  5943.39,  6.5904,  165S65.,  885.96,  103355.,  236.83,  0.117769,  29.8538) 

NO  6  ■  <  5531.11,  6.7031,  173647.,  865.98,  73258.,  336.83,  0.105344.  28.9416) 

NO  7  -  C  6040.07,  6.6350,  171116.,  794.10,  103261.,  237.98,  0.102906,  28.8511) 

NO  8  ■  (  6123.78,  6.5865,  173906.,  814.59,  98530.,  329.34.  0.096418,  29.3088) 

NO  9  ■  (  6110.92,  6.7922,  167735.,  868.28,  98339.,  233.3S.  0.106042,  28.9788) 

NO  10  *  (  6364.69,  6.5230,  166074.,  784.07,  108436.,  327.84,  0.103923,  29.2060) 
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PROBLEN  NO  23-2 
SOLUTION  l 


( 

5154.08. 

6.6200. 

169485.. 

743.89. 

87999. , 

189.54. 

0.125831, 

29.2653) 

STARTING  POINTS  » 

NO 

1  - 

( 

5590.88. 

6.6036. 

169295.. 

793.15. 

96443.. 

213.25. 

0.121369. 

29.5905) 

NO 

2  - 

< 

5690.28. 

6.5770. 

169765.. 

707.70. 

97051 . , 

202.92. 

0.116128. 

29.2390) 

NO 

3  ■ 

( 

5703.28. 

6.5897. 

172564.. 

804.27. 

95168.. 

211.25. 

0.122959. 

29.4826) 

NO 

4  » 

( 

5213.21. 

6.6090. 

171391.. 

823.52. 

86300., 

201.12. 

0.111734, 

29.5902) 

NO 

5  « 

( 

5492.60. 

6.5876. 

180109.. 

842.34. 

81416.. 

200.74. 

0.125415. 

28.8854) 

NO 

6  ■ 

( 

5661.00* 

6.7165. 

168486.. 

800.56. 

83882.. 

187.91. 

0.113152. 

28.8940) 

NO 

7  » 

< 

5768.59. 

6.6125. 

169203.. 

818.79. 

95808.. 

201.67. 

0.120203. 

29.222S) 

NO 

8  ■ 

( 

5618.18. 

6.6137. 

178747.. 

829.11. 

91094.. 

197.42. 

0.116461. 

29.4211) 

NO 

9  ■ 

( 

5602.61. 

6.7064. 

181492.. 

795.94, 

94296.. 

198.74. 

0.117106. 

29.0616) 

NO  10 


(  5635.48.  6.5511.  168006..  780.37.  87094..  208.71 


0.113898.  29.4058) 


SOLUTION  l 


(  0.804050*  0.901863*  0.997800.  0.100000*  0.193638*  0.009993*  958.30*  78.9389*  900.00. 
0.100001*  19.8948*  78.1710*  0.003497) 

STORTING  POINTS  t 

NO  1  ■  (  0.800899*  0.900018*  0.933849*  0.099385*  0.193838*  0.883556*  998.30*  73.8878*  501.65* 
0.100188*  80.6868*  80.9088*  0.015613) 

.NO  8  ■  <  0.803088*  0.900686*  0.989804*  0.099558*  0.193080*  0.879887*  568.39,  78.6881*  501.86* 
0.100089*  81.0665*  78.8407*  0.016078) 
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PROBLEM  MO  85-1 
SOLUTION  t 

t  679.40*  532.66.  346.07.  435.55.  164.45.  1000.00*  100.00*  1.0E-005.  100.0000. 

10959..  3502.59.  467.63.  1.0E-005.  1.0E-005) 

STARTING  POINTS  1 

ID  !■(  666.44.  516.68.  346.74.  444.37.  151.64.  906.60.  98.4436.  8.5E-006.  99.3388. 

13721..  3705.64.  512.85.  8.2E-006.  1.1E-005) 

'MO  2  ■  C  670.55.  524.52.  349.69.  423.67.  164.32.  973.69.  96.8481.  7.5E-006.  99.7027. 

12051..  4085.23.  S67.92.  9.1E-006.  1.0E-005) 

MO  3  »  <  667.97.  524.11.  349.70.  437.67.  160.96.  794.11.  99.0721.  1.2E-005.  99.8687. 

12198..  4012.98.  480.44.  1.2E-005.  8.4E-006) 

MO  4  «  <  666.17.  534.26.  336.41.  428.09.  168.70.  976.11.  98.6953.  9.SE-006.  98.7308. 

12342..  3751.45.  574.99.  1.2E-00S.  7.8E-006) 

MO  5  -  (  668.07.  531.21.  339.13.  428.60.  164.61.  868.02.  98.0965.  1.2E-005.  98.6388. 

12497..  4304.11.  504.70.  8.6E-006.  1.1E-005) 

NO  6  •  (  666.14.  518.90.  336.79.  432.89.  142.93.  962.08.  97.4475.  1.1E-005.  98.6568. 

12799..  3519.78.  526.08.  1.3E-005.  1.2E-005) 

NO  7  -  (  666.15.  520.44.  346.33.  424.97.  157.70.  870.94.  97.4398.  9.6E-006.  99.8639. 

13445..  3957.99.  496.69.  7.9E-006.  1.1E-005) 
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PROHJEH  NO  29-2 
SOLUTION  i 

(  679.40*  532.66*  346.07*  435.55*  164.45*  1000.00*  100.00*  1.0E-005*  100.0000* 

10959.*  3502.59*  467.63*  1.0E-005*  1.0E-005) 

STORTING  POINTS  t 

NO  1  ■  C  676.31*  527.55*  343.05*  426.77*  162.95.  890.24*  99.3425*  9.4E-006*  99.8500* 

11300.*  3590.86*  509.72*  1.0E-005*  9.8E-006) 

NO  2  ■  (  674.38.  530.26*  344.92*  411.45*  161.69.  990.23*  98.1455*  1.1E-005*  99.5782* 

11971.*  3692.86*  499.60*  9.8E-006*  1.1E-005) 
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PRULEH  NO  26-3 
SOLUTION  t 

(  0.603772*  0.817513.  0.900000.  0.900000*  0.900000*  0.100000*  0.107884*  0.190837*  0.190837* 
0.190837*  505.66*  5.6651*  72.4752*  500.00*  500.00*  1.0E-006) 

STARTING  POINTS  » 

NO  !■(  0.774701*  0.802429*  0.888789*  0.899360*  0.901714*  0.099219*  0.107788*  0.190048*  0.190172* 
0.194380*  501.10*  5.5035*  70.9103*  515.84*  500.66*  1.0E-006) 


APPRNOIX  C: 

Code  Parameters 

OPT: 

EPSIS 

o 

■ 

.  a* 

EPSBD 

10“4 

EPS 

10"6 

CRIT 

10"4 

GGP: 

EPSCON 

10-8 

EPSCGP 

10-6 

EPSLP 

10*11 

EPSPN 

10"11 

GPKTC: 

EPSCON 

10"4 

EPSDO 

10"3 

BETA 

10'2 

BS 

1.0 

QUADGP : 

EPSCOV 

10"5 

EPSTOL 

10"3 

VELTOL 

o 

1 

•  ^4 

EPS 

10"3 

TOLCON 

10*6 

EPSEQ 

<£>  v 
1 

o 

EPSEQ 

10"° 

EPSVAR 

10"3 

GENTOL 

10-8 

RLOWR 

10_1 

RUPPER 

10+1 

DAP: 

EPS 

10-6 

EPSI 

I 

o 

EPS2 

10-4 

EPS3 

10-6 

EPS4 

10'4 

RRR 

104 

